Jul 10 07:37:42 devstack cinder-volume[75943]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 07:37:42 devstack cinder-volume[75943]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 07:37:42 devstack cinder-volume[75943]: we strongly recommend against using it for new projects. Jul 10 07:37:42 devstack cinder-volume[75943]: If you are already using Eventlet, we recommend migrating to a different Jul 10 07:37:42 devstack cinder-volume[75943]: framework. For more detail see Jul 10 07:37:42 devstack cinder-volume[75943]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 07:37:42 devstack cinder-volume[75943]: import eventlet # noqa Jul 10 07:37:45 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:37:45 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:37:45 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:37:45 devstack cinder-volume[75943]: INFO dbcounter [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Registered counter for database cinder Jul 10 07:37:45 devstack cinder-volume[75943]: DEBUG oslo_db.sqlalchemy.engines [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:37:46 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writer thread running {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:37:46 devstack cinder-volume[75943]: INFO cinder.rpc [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 07:37:46 devstack cinder-volume[75943]: INFO cinder.rpc [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 07:37:46 devstack cinder-volume[75943]: DEBUG oslo_db.sqlalchemy.engines [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:37:46 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Determined volume DB was empty at startup. Jul 10 07:37:46 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75943) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 07:37:46 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 07:37:46 devstack cinder-volume[75943]: WARNING stevedore.named [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 07:37:46 devstack cinder-volume[75943]: WARNING castellan.key_manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:37:46 devstack cinder-volume[75943]: WARNING cinder.keymgr.conf_key_mgr [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:37:46 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75943) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 07:37:46 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_db.sqlalchemy.engines [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:37:47 devstack cinder-volume[75943]: INFO cinder.rpc [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 07:37:47 devstack cinder-volume[75943]: INFO cinder.rpc [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 07:37:47 devstack cinder-volume[75943]: WARNING stevedore.named [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 07:37:47 devstack cinder-volume[75943]: WARNING castellan.key_manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:37:47 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_db.sqlalchemy.engines [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:37:47 devstack cinder-volume[75943]: INFO oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Starting 1 workers Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Started child 76103 {{(pid=75943) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Full set of CONF: {{(pid=75943) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] ******************************************************************************** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Configuration options gathered from: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] ================================================================================ {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 07:37:47 devstack cinder-volume[76103]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] allow_availability_zone_fallback = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] allow_compression_on_image_upload = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] allowed_direct_url_schemes = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] api_rate_limit = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] auth_strategy = keystone {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] az_cache_duration = 3600 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_availability_zone = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_host = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_stats_polling_interval = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backup_api_class = cinder.backup.api.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backup_name_template = backup-%s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backup_use_same_host = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backup_use_temp_snapshot = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] chap_password = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] chap_username = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_internal_tenant_project_id = 803baf903f5c4ad8854824a7de91b4e0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_internal_tenant_user_id = 8f0b5fcf8c4f45758d3b45f5c46a3693 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cloned_volume_same_az = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cluster = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] compression_format = gzip {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] compute_api_class = cinder.compute.nova.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] config_dir = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] config_source = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] control_exchange = openstack {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] debug = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] default_availability_zone = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] default_group_type = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] default_volume_type = lvmdriver-1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] disk_geometry = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_client_cert = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_client_cert_key = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_data_namespace = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_ssl_cert_path = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_ssl_cert_verify = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] driver_use_ssl = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] enable_force_upload = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] enable_new_services = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] enable_unsupported_driver = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] enforce_multipath_for_image_xfer = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] filter_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_api_insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_api_ssl_compression = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_ca_certificates_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_catalog_info = image:glance:publicURL {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_num_retries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance_request_timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] goodness_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] graceful_shutdown_timeout = 5 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] group_api_class = cinder.group.api.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] host = devstack {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_compress_on_upload = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_conversion_address_space_limit = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_conversion_cpu_limit = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[76103]: INFO cinder.volume.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_conversion_disable = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_upload_use_cinder_backend = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_upload_use_internal_tenant = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_volume_cache_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_volume_cache_max_count = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] image_volume_cache_max_size_gb = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] init_host_max_objects_retrieval = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] instance_format = [instance: %(uuid)s] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iscsi_target_flags = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iscsi_write_cache = on {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iser_helper = tgtadm {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iser_ip_address = 192.168.122.68 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iser_port = 3260 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_color = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_config_append = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_dir = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_options = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_rotate_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_rotate_interval_type = days {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] log_rotation_type = none {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] max_age = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] max_logfile_count = 30 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] max_logfile_size_mb = 200 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] max_over_subscription_ratio = 20.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] message_reap_interval = 86400 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] message_ttl = 2592000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] migration_create_volume_timeout_secs = 300 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] monkey_patch = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] monkey_patch_modules = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] my_ip = 192.168.122.68 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] no_snapshot_gb_quota = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] num_iser_scan_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] num_shell_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] num_volume_device_scan_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] nvmeof_conn_info_version = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] nvmet_ns_id = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] nvmet_port_id = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_max_limit = 1000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_ext_list = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_listen_port = 8776 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_use_ssl = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] osapi_volume_workers = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] per_volume_size_limit = -1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] periodic_fuzzy_delay = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] periodic_interval = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] public_endpoint = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] publish_errors = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_backup_gigabytes = 1000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_backups = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_gigabytes = 1000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_groups = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_snapshots = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] quota_volumes = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] rate_limit_burst = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] rate_limit_except_level = CRITICAL {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] rate_limit_interval = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] reinit_driver_count = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] replication_device = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] report_discard_supported = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] report_interval = 120 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] reservation_clean_interval = 86400 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] reservation_expire = 86400 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] reserved_image_namespaces = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] reserved_percentage = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] rpc_response_timeout = 120 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] run_external_periodic_tasks = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] scst_target_driver = iscsi {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] scst_target_iqn_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_down_time = 720 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] shell_completion = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] snapshot_name_template = snapshot-%s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] snapshot_same_host = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] split_loggers = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] state_path = /opt/stack/data/cinder {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] storage_availability_zone = nova {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] storage_protocol = iSCSI {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] syslog_log_facility = LOG_USER {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_helper = lioadm {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_ip_address = 192.168.122.68 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_port = 3260 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_protocol = iscsi {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] target_secondary_ip_addresses = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] trace_flags = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] transport_url = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] until_refresh = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_chap_auth = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_default_quota_class = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_journal = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_json = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_multipath_for_image_xfer = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_stderr = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] use_syslog = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] verify_glance_signatures = enabled {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_api_class = cinder.volume.api.API {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_backend_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_clear = zero {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_clear_ionice = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_clear_size = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_copy_bps_limit = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_dd_blocksize = 1M {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_name_template = volume-%s {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_service_inithost_offload = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volume_usage_audit_period = month {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] zoning_mode = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_concurrency.disable_process_locking = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.auth_section = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.auth_type = password {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.auth_version = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.cache = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.include_service_catalog = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.interface = public {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_password = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcache_username = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.region_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.service_type = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.backend = dogpile.cache.null {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.backend_argument = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.backend_expiration_time = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.config_prefix = cache.oslo {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.debug_cache_backend = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.enable_retry_client = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.enable_socket_keepalive = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.expiration_time = 600 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.hashclient_retry_attempts = 2 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_dead_retry = 300 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_pool_maxsize = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_sasl_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.password = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.proxies = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.redis_db = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.redis_server = localhost:6379 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.retry_attempts = 2 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.retry_delay = 0.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.socket_keepalive_count = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.socket_keepalive_idle = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.socket_keepalive_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.socket_timeout = 1.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.tls_allowed_ciphers = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.tls_cafile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.tls_certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.tls_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.tls_keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cache.username = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] coordination.backend_url = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.asyncio_connection = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.asyncio_slave_connection = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.backend = sqlalchemy {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.connection = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack sudo[76107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.connection_debug = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.connection_parameters = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.connection_recycle_time = 3600 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.connection_trace = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.db_inc_retry_interval = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.db_max_retries = 20 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.db_max_retry_interval = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack sudo[76107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.db_retry_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.max_overflow = 50 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.max_pool_size = 5 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.max_retries = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.mysql_wsrep_sync_wait = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.pool_timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.retry_interval = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.slave_connection = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.sqlite_synchronous = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.synchronous_reader = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] database.use_db_reconnect = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.connection_string = messaging:// {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.es_doc_type = notification {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.es_scroll_size = 10000 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.es_scroll_time = 2m {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.filter_error_trace = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.hmac_keys = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.sentinel_service_name = mymaster {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.socket_timeout = 0.1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.trace_requests = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler.trace_sqlalchemy = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler_jaeger.process_tags = {} {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler_jaeger.service_name_prefix = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] profiler_otlp.service_name_prefix = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.enforce_new_defaults = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.enforce_scope = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.policy_default_rule = default {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.policy_file = policy.yaml {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.group = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.helper_command = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] privsep_osbrick.user = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.group = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.helper_command = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] cinder_sys_admin.user = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.auth_section = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.auth_type = password {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.cafile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.collect_timing = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.send_service_user_token = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.split_loggers = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] service_user.timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.auth_section = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.auth_type = password {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.collect_timing = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.region_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.split_loggers = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] glance.timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.backend_availability_zone = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.chap_password = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.chap_username = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.disk_geometry = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_client_cert = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_client_cert_key = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_data_namespace = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.driver_use_ssl = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.extra_capabilities = {} {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.filter_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.goodness_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iscsi_target_flags = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iscsi_write_cache = on {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iser_helper = tgtadm {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iser_port = 3260 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.lvm_share_target = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.lvm_type = auto {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.num_shell_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.replication_device = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.report_discard_supported = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.reserved_percentage = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_helper = tgtadm {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_port = 3260 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_protocol = iscsi {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.trace_flags = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.unique_fqdn_network = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.use_chap_auth = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_backend_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_clear = zero {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_clear_ionice = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_clear_size = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_reports.file_event_handler = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_reports.log_dir = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.backend_host = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.chap_password = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.chap_username = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.disk_geometry = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_client_cert = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.extra_capabilities = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.filter_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.goodness_function = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iser_helper = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iser_ip_address = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iser_port = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.lvm_share_target = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.lvm_type = auto {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.num_shell_tries = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.replication_device = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.report_discard_supported = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.reserved_percentage = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.scst_target_driver = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.storage_protocol = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_helper = lioadm {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_ip_address = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_port = 3260 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.trace_flags = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.use_chap_auth = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_clear = zero {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_clear_size = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] lvmdriver-1.volumes_dir = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_notifications.driver = [] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_notifications.retry = -1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] key_manager.fixed_key = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.barbican_api_version = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.barbican_endpoint = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.barbican_endpoint_type = public {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.barbican_region_name = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.cafile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.collect_timing = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.number_of_retries = 60 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.retry_delay = 1 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.send_service_user_token = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.split_loggers = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.verify_ssl = True {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican.verify_ssl_path = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.auth_section = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.auth_type = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.cafile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.certfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.collect_timing = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.insecure = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.keyfile = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.split_loggers = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] barbican_service_user.timeout = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.approle_role_id = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.approle_secret_id = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.kv_mountpoint = secret {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.kv_path = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.kv_version = 2 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.namespace = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.root_token_id = **** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.ssl_ca_crt_file = None {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.timeout = 60.0 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.use_ssl = False {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:37:47 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] ******************************************************************************** {{(pid=75943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 07:37:48 devstack sudo[76107]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:48 devstack sudo[76159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:48 devstack sudo[76159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:48 devstack sudo[76159]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.649s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:37:48 devstack cinder-volume[76103]: INFO cinder.brick.local_dev.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:48 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:48 devstack sudo[76406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:37:48 devstack sudo[76406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:49 devstack sudo[76406]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:49 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:49 devstack cinder-volume[76103]: DEBUG cinder.brick.local_dev.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76103) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 07:37:49 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:49 devstack sudo[76594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:49 devstack sudo[76594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:50 devstack sudo[76594]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:50 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.550s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:50 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:51 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:51 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:51 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.817s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:51 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:51 devstack sudo[76887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 07:37:51 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:52 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:52 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.821s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:52 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:52 devstack sudo[76896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:37:52 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:53 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.829s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:53 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:37:53 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:54 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.835s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:54 devstack sudo[76907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:37:54 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:55 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.758s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:55 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:55 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:55 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:55 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:55 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:56 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:56 devstack cinder-volume[76103]: INFO cinder.volume.drivers.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 07:37:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:56 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:56 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:57 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:57 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:57 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:37:57 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:57 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:37:57 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:57 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:37:57 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:57 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:57 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:57 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:37:57 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:58 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:58 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:58 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:58 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:37:58 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:59 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:37:59 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:37:59 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:37:59 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:37:59 devstack cinder-volume[76103]: INFO cinder.volume.driver [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG cinder.volume.driver [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76103) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG oslo_db.sqlalchemy.engines [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writer thread running {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG cinder.db.api [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Building query based on filter {{(pid=76103) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG cinder.image.image_utils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76103) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 07:37:59 devstack cinder-volume[76103]: INFO cinder.keymgr.migration [None req-17a66e73-7d03-4388-a3ba-4e8518b9ebf1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:37:59 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:00 devstack sudo[77209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:38:00 devstack sudo[77209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:00 devstack sudo[77209]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:00 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:00 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:00 devstack sudo[77212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:00 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:01 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:01 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:01 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:01 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:38:01 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:01 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:01 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:01 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:01 devstack sudo[77219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:01 devstack sudo[77219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:02 devstack sudo[77219]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG cinder.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Notifying Schedulers of capabilities ... {{(pid=76103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:38:02 devstack cinder-volume[76103]: INFO cinder.volume.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Driver initialization completed successfully. Jul 10 07:38:02 devstack cinder-volume[76103]: INFO cinder.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Initiating service 2 cleanup Jul 10 07:38:02 devstack cinder-volume[76103]: INFO cinder.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Service 2 cleanup completed. Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG cinder.service [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Creating RPC server for service cinder-volume {{(pid=76103) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG cinder.service [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76103) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 07:38:02 devstack cinder-volume[76103]: INFO cinder.volume.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:38:02 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:02 devstack sudo[77223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:38:02 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:03 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:03 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:03 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:03 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:03 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:04 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:04 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:04 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:04 devstack sudo[77241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:38:04 devstack sudo[77241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:04 devstack sudo[77241]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:04 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:04 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:04 devstack sudo[77289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:04 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:05 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:05 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:05 devstack cinder-volume[76103]: INFO cinder.volume.manager [None req-6a350863-1f9b-4399-864f-8787ce22c266 None None] Driver post RPC initialization completed successfully. Jul 10 07:38:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:SELECT=3 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:38:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:38:53 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:38:53 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:38:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:53 devstack sudo[78899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:38:53 devstack sudo[78899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:54 devstack sudo[78899]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:54 devstack sudo[78902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:54 devstack sudo[78902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:54 devstack sudo[78902]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:54 devstack sudo[78921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:38:54 devstack sudo[78921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:55 devstack sudo[78921]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:38:55 devstack sudo[78948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:38:55 devstack sudo[78948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:38:56 devstack sudo[78948]: pam_unix(sudo:session): session closed for user root Jul 10 07:38:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:38:56 devstack cinder-volume[76103]: DEBUG cinder.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Notifying Schedulers of capabilities ... {{(pid=76103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:38:56 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager._thread_info {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:38:56 devstack cinder-volume[76103]: DEBUG cinder.volume.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] thread count: 6 {{(pid=76103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:38:56 devstack cinder-volume[76103]: DEBUG cinder.volume.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] thread info: [<_MainThread(MainThread, started 127783854637184)>, , , , , ] {{(pid=76103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:39:53 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:39:53 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:39:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:39:53 devstack sudo[82206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:39:53 devstack sudo[82206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:39:54 devstack sudo[82206]: pam_unix(sudo:session): session closed for user root Jul 10 07:39:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:39:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:39:54 devstack sudo[82209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:39:54 devstack sudo[82209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:39:54 devstack sudo[82209]: pam_unix(sudo:session): session closed for user root Jul 10 07:39:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:39:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:39:54 devstack sudo[82212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:39:54 devstack sudo[82212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:39:55 devstack sudo[82212]: pam_unix(sudo:session): session closed for user root Jul 10 07:39:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:39:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:39:55 devstack sudo[82215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:39:55 devstack sudo[82215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:39:56 devstack sudo[82215]: pam_unix(sudo:session): session closed for user root Jul 10 07:39:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:39:56 devstack cinder-volume[76103]: DEBUG cinder.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Notifying Schedulers of capabilities ... {{(pid=76103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:40:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:SELECT=1 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:40:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:UPDATE=1 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:40:53 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:40:53 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:40:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:40:53 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:40:53 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:40:54 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Jul 10 07:40:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:40:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:40:54 devstack sudo[84063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:40:54 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:40:54 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root Jul 10 07:40:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:40:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:40:54 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:40:54 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:40:55 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Jul 10 07:40:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:40:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:40:55 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:40:55 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:40:56 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Jul 10 07:40:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:40:56 devstack cinder-volume[76103]: DEBUG cinder.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Notifying Schedulers of capabilities ... {{(pid=76103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:40:56 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager._thread_info {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:40:56 devstack cinder-volume[76103]: DEBUG cinder.volume.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] thread count: 6 {{(pid=76103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:40:56 devstack cinder-volume[76103]: DEBUG cinder.volume.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] thread info: [<_MainThread(MainThread, started 127783854637184)>, , , , , ] {{(pid=76103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:41:53 devstack cinder-volume[76103]: DEBUG oslo_service.periodic_task [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:41:53 devstack cinder-volume[76103]: DEBUG cinder.volume.drivers.lvm [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Updating volume stats {{(pid=76103) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 07:41:53 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:41:53 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 07:41:53 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:41:54 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Jul 10 07:41:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:41:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:41:54 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:41:54 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:41:54 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Jul 10 07:41:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:41:54 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:41:54 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 07:41:54 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:41:55 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Jul 10 07:41:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:41:55 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:41:55 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 07:41:55 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:41:56 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Jul 10 07:41:56 devstack cinder-volume[76103]: DEBUG oslo_concurrency.processutils [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:41:56 devstack cinder-volume[76103]: DEBUG cinder.manager [None req-21cef362-20de-4f36-ae8e-111b85d25e48 None None] Notifying Schedulers of capabilities ... {{(pid=76103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:42:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:SELECT=1 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:42:15 devstack cinder-volume[76103]: DEBUG dbcounter [-] [76103] Writing DB stats cinder:UPDATE=1 {{(pid=76103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:42:27 devstack cinder-volume[75943]: INFO oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Caught SIGTERM, stopping children Jul 10 07:42:27 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Acquiring lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:27 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Acquired lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:27 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Releasing lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:27 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Stop services. {{(pid=75943) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 07:42:27 devstack cinder-volume[75943]: DEBUG oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Killing children. {{(pid=75943) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 07:42:27 devstack cinder-volume[75943]: INFO oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Waiting on 1 children to exit Jul 10 07:42:27 devstack cinder-volume[76103]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Acquiring lock "singleton_lock" {{(pid=76103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:27 devstack cinder-volume[76103]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Acquired lock "singleton_lock" {{(pid=76103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:27 devstack cinder-volume[76103]: DEBUG oslo_concurrency.lockutils [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Releasing lock "singleton_lock" {{(pid=76103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:27 devstack cinder-volume[76103]: WARNING amqp [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 07:42:27 devstack cinder-volume[76103]: WARNING amqp [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 07:42:27 devstack cinder-volume[75943]: INFO oslo_service.backend._eventlet.service [None req-dd49d655-e295-4777-9f86-e5c648be804b None None] Child 76103 exited with status 0 Jul 10 07:42:28 devstack cinder-volume[86200]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 07:42:28 devstack cinder-volume[86200]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 07:42:28 devstack cinder-volume[86200]: we strongly recommend against using it for new projects. Jul 10 07:42:28 devstack cinder-volume[86200]: If you are already using Eventlet, we recommend migrating to a different Jul 10 07:42:28 devstack cinder-volume[86200]: framework. For more detail see Jul 10 07:42:28 devstack cinder-volume[86200]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 07:42:28 devstack cinder-volume[86200]: import eventlet # noqa Jul 10 07:42:30 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:30 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:30 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:30 devstack cinder-volume[86200]: INFO dbcounter [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Registered counter for database cinder Jul 10 07:42:30 devstack cinder-volume[86200]: DEBUG oslo_db.sqlalchemy.engines [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86200) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG dbcounter [-] [86200] Writer thread running {{(pid=86200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:42:31 devstack cinder-volume[86200]: INFO cinder.rpc [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 07:42:31 devstack cinder-volume[86200]: INFO cinder.rpc [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_db.sqlalchemy.engines [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86200) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:31 devstack cinder-volume[86200]: INFO cinder.volume.manager [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Determined volume DB was empty at startup. Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG cinder.volume.manager [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86200) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 07:42:31 devstack cinder-volume[86200]: INFO cinder.volume.manager [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 07:42:31 devstack cinder-volume[86200]: WARNING stevedore.named [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 07:42:31 devstack cinder-volume[86200]: WARNING castellan.key_manager [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:42:31 devstack cinder-volume[86200]: WARNING cinder.keymgr.conf_key_mgr [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:42:31 devstack cinder-volume[86200]: INFO cinder.volume.manager [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_db.sqlalchemy.engines [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86200) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:31 devstack cinder-volume[86200]: INFO oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Starting 1 workers Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Started child 86417 {{(pid=86200) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Full set of CONF: {{(pid=86200) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] ******************************************************************************** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Configuration options gathered from: {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] ================================================================================ {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] allow_availability_zone_fallback = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] allow_compression_on_image_upload = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] allowed_direct_url_schemes = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] api_rate_limit = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] auth_strategy = keystone {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_availability_zone = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_host = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_stats_polling_interval = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backup_api_class = cinder.backup.api.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86417]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backup_name_template = backup-%s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backup_use_same_host = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backup_use_temp_snapshot = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] chap_password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] chap_username = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_internal_tenant_project_id = 803baf903f5c4ad8854824a7de91b4e0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_internal_tenant_user_id = 8f0b5fcf8c4f45758d3b45f5c46a3693 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cluster = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] compression_format = gzip {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] compute_api_class = cinder.compute.nova.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] config_dir = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] config_source = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] control_exchange = openstack {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] debug = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] default_availability_zone = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] default_group_type = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] default_volume_type = QuobyteHD {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] disk_geometry = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_client_cert = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_client_cert_key = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_data_namespace = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_ssl_cert_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_ssl_cert_verify = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] driver_use_ssl = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] enable_new_services = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] enable_unsupported_driver = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] enabled_backends = ['QuobyteHD'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] enforce_multipath_for_image_xfer = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] filter_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_api_insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_api_ssl_compression = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_ca_certificates_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_catalog_info = image:glance:publicURL {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_num_retries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance_request_timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] goodness_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] graceful_shutdown_timeout = 5 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] group_api_class = cinder.group.api.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] host = devstack {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_compress_on_upload = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_conversion_address_space_limit = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_conversion_cpu_limit = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_conversion_disable = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_upload_use_cinder_backend = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_upload_use_internal_tenant = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_volume_cache_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_volume_cache_max_count = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] image_volume_cache_max_size_gb = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] init_host_max_objects_retrieval = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] instance_format = [instance: %(uuid)s] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iscsi_target_flags = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iscsi_write_cache = on {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iser_helper = tgtadm {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iser_ip_address = 192.168.122.68 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iser_port = 3260 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_color = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_config_append = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_dir = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_options = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_rotate_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_rotate_interval_type = days {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] log_rotation_type = none {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] max_age = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] max_logfile_count = 30 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] max_logfile_size_mb = 200 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] max_over_subscription_ratio = 20.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] message_reap_interval = 86400 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] message_ttl = 2592000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] migration_create_volume_timeout_secs = 300 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] monkey_patch = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] monkey_patch_modules = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] my_ip = 192.168.122.68 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] no_snapshot_gb_quota = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] num_iser_scan_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] num_shell_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] num_volume_device_scan_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] nvmeof_conn_info_version = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] nvmet_ns_id = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] nvmet_port_id = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_max_limit = 1000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_ext_list = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_listen_port = 8776 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_use_ssl = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] osapi_volume_workers = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] per_volume_size_limit = -1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] periodic_fuzzy_delay = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] periodic_interval = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] public_endpoint = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] publish_errors = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_backup_gigabytes = 1000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_backups = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_gigabytes = 1000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_groups = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_snapshots = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] quota_volumes = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] rate_limit_burst = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] rate_limit_except_level = CRITICAL {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] rate_limit_interval = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] reinit_driver_count = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] replication_device = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] report_discard_supported = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] report_interval = 120 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] reservation_clean_interval = 86400 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] reservation_expire = 86400 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] reserved_image_namespaces = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] reserved_percentage = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] rpc_response_timeout = 120 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] run_external_periodic_tasks = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] scst_target_driver = iscsi {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] scst_target_iqn_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_down_time = 720 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] shell_completion = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] snapshot_name_template = snapshot-%s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] split_loggers = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] state_path = /opt/stack/data/cinder {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] storage_availability_zone = nova {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] storage_protocol = iSCSI {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] syslog_log_facility = LOG_USER {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_helper = lioadm {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_ip_address = 192.168.122.68 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_port = 3260 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_protocol = iscsi {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] target_secondary_ip_addresses = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] trace_flags = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] transport_url = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] until_refresh = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_chap_auth = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_default_quota_class = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_journal = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_json = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_multipath_for_image_xfer = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_stderr = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] use_syslog = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] verify_glance_signatures = enabled {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_api_class = cinder.volume.api.API {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_backend_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_clear = zero {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.remotefs [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86417) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_clear_ionice = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_clear_size = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_copy_bps_limit = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_dd_blocksize = 1M {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_name_template = volume-%s {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_service_inithost_offload = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volume_usage_audit_period = month {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] zoning_mode = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_concurrency.disable_process_locking = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.auth_section = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.auth_type = password {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.auth_version = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.cache = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.include_service_catalog = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.interface = public {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_password = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcache_username = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.region_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.service_type = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.backend = dogpile.cache.null {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.backend_argument = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.backend_expiration_time = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.config_prefix = cache.oslo {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.debug_cache_backend = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.enable_retry_client = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.enable_socket_keepalive = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.expiration_time = 600 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.hashclient_retry_attempts = 2 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_dead_retry = 300 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_pool_maxsize = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_sasl_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.proxies = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.redis_db = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.redis_server = localhost:6379 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.retry_attempts = 2 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.retry_delay = 0.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.socket_keepalive_count = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.socket_keepalive_idle = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.socket_keepalive_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.socket_timeout = 1.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.tls_allowed_ciphers = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.tls_cafile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.tls_certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.tls_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.tls_keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cache.username = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] coordination.backend_url = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.asyncio_connection = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.asyncio_slave_connection = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.backend = sqlalchemy {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.connection = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.connection_debug = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.connection_parameters = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.connection_recycle_time = 3600 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.connection_trace = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.db_inc_retry_interval = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.db_max_retries = 20 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.db_max_retry_interval = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.db_retry_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.max_overflow = 50 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.max_pool_size = 5 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.max_retries = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.mysql_wsrep_sync_wait = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.pool_timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.retry_interval = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.slave_connection = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.sqlite_synchronous = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.synchronous_reader = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] database.use_db_reconnect = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.connection_string = messaging:// {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.es_doc_type = notification {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.es_scroll_size = 10000 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.es_scroll_time = 2m {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.filter_error_trace = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.hmac_keys = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.sentinel_service_name = mymaster {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.socket_timeout = 0.1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.trace_requests = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler.trace_sqlalchemy = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler_jaeger.process_tags = {} {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler_jaeger.service_name_prefix = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] profiler_otlp.service_name_prefix = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.enforce_new_defaults = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.enforce_scope = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.policy_default_rule = default {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.policy_file = policy.yaml {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.group = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.helper_command = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] privsep_osbrick.user = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.group = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.helper_command = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] cinder_sys_admin.user = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.auth_section = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.auth_type = password {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.cafile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.collect_timing = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.send_service_user_token = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.split_loggers = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] service_user.timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.auth_section = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.auth_type = password {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.collect_timing = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.region_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.split_loggers = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] glance.timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.backend_availability_zone = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.chap_password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.chap_username = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.disk_geometry = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_client_cert = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_client_cert_key = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_data_namespace = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.driver_use_ssl = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.extra_capabilities = {} {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.filter_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.goodness_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iscsi_target_flags = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iscsi_write_cache = on {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iser_helper = tgtadm {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iser_port = 3260 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_host = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_login = admin {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_mount_options = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_private_key = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_share_path = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.num_shell_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.quobyte_volume_url = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.replication_device = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.report_discard_supported = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.reserved_percentage = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_helper = tgtadm {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_port = 3260 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_protocol = iscsi {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.trace_flags = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.unique_fqdn_network = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.use_chap_auth = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_backend_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_clear = zero {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_clear_ionice = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_clear_size = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_reports.file_event_handler = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_reports.log_dir = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.backend_availability_zone = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.backend_host = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.chap_password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.chap_username = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.chiscsi_conf = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.disk_geometry = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_client_cert = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_data_namespace = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.driver_use_ssl = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.extra_capabilities = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.filter_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.goodness_function = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iser_helper = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iser_ip_address = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iser_port = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.iser_target_prefix = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_host = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_login = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_mount_options = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_password = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_private_key = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_share_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_ssh_port = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.num_shell_tries = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.nvmet_port_id = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.replication_device = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.report_discard_supported = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.reserved_percentage = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.scst_target_driver = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.storage_protocol = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_helper = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_ip_address = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_port = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_prefix = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_protocol = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.trace_flags = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.use_chap_auth = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_clear = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_clear_size = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86417) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 07:42:31 devstack cinder-volume[86417]: WARNING cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 07:42:31 devstack cinder-volume[86417]: WARNING cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] QuobyteHD.volumes_dir = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_notifications.driver = [] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_notifications.retry = -1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] key_manager.fixed_key = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.barbican_api_version = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.barbican_endpoint = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.barbican_endpoint_type = public {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.barbican_region_name = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.cafile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.collect_timing = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.number_of_retries = 60 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.retry_delay = 1 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.send_service_user_token = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.split_loggers = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.verify_ssl = True {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican.verify_ssl_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.auth_section = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.auth_type = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.cafile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.certfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.collect_timing = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.insecure = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.keyfile = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.split_loggers = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] barbican_service_user.timeout = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.approle_role_id = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.approle_secret_id = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.kv_mountpoint = secret {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.kv_path = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.kv_version = 2 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.namespace = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.root_token_id = **** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.ssl_ca_crt_file = None {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.timeout = 60.0 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.use_ssl = False {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:31 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] ******************************************************************************** {{(pid=86200) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 07:42:31 devstack quobyte-client[86422]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 07:42:31 devstack quobyte-client[86422]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=86417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:32 devstack cinder-volume[86417]: INFO cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 ... Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 -c /etc/quobyte/client-cinder.cfg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:32 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 -c /etc/quobyte/client-cinder.cfg Jul 10 07:42:32 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:32 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.788s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:32 devstack cinder-volume[86417]: INFO cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 succeeded Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=86417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.819s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:32 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:32 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:32 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:33 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.659s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:33 devstack cinder-volume[86417]: INFO cinder.volume.driver [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG cinder.volume.driver [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86417) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_db.sqlalchemy.engines [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG dbcounter [-] [86417] Writer thread running {{(pid=86417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG cinder.db.api [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Building query based on filter {{(pid=86417) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG cinder.image.image_utils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86417) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 07:42:33 devstack cinder-volume[86417]: INFO cinder.keymgr.migration [None req-47f8353a-a41d-4118-ae5c-66692ceb7e72 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=86417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=86417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:33 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:33 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:33 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:34 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.799s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG cinder.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Notifying Schedulers of capabilities ... {{(pid=86417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:42:34 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Driver initialization completed successfully. Jul 10 07:42:34 devstack cinder-volume[86417]: INFO cinder.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Initiating service 3 cleanup Jul 10 07:42:34 devstack cinder-volume[86417]: INFO cinder.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Service 3 cleanup completed. Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG cinder.service [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Creating RPC server for service cinder-volume {{(pid=86417) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG cinder.service [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86417) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 07:42:34 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=86417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=86417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:34 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:34 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:34 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:35 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:35 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.824s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:35 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-ff3b0c14-5cfe-423b-8216-893a37aa58f4 None None] Driver post RPC initialization completed successfully. Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=86417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG cinder.volume.drivers.quobyte [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=86417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:39 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:39 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:39 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:40 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:40 devstack cinder-volume[86417]: DEBUG oslo_concurrency.processutils [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.657s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:40 devstack cinder-volume[86417]: DEBUG cinder.manager [None req-270cad15-967e-40de-bc5b-3932b1f23825 None None] Notifying Schedulers of capabilities ... {{(pid=86417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:42:40 devstack cinder-volume[86200]: INFO oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Caught SIGTERM, stopping children Jul 10 07:42:40 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Acquiring lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:40 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Acquired lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:40 devstack cinder-volume[86200]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Releasing lock "singleton_lock" {{(pid=86200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:40 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Stop services. {{(pid=86200) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 07:42:40 devstack cinder-volume[86200]: DEBUG oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Killing children. {{(pid=86200) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 07:42:40 devstack cinder-volume[86200]: INFO oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Waiting on 1 children to exit Jul 10 07:42:42 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Acquiring lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:42 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Acquired lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:42 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Releasing lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:42 devstack cinder-volume[86417]: WARNING amqp [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 07:42:42 devstack cinder-volume[86417]: WARNING amqp [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 07:42:42 devstack cinder-volume[86200]: INFO oslo_service.backend._eventlet.service [None req-07fcbe5c-680a-405f-99d4-4ccb6faaeb96 None None] Child 86417 exited with status 0 Jul 10 07:42:43 devstack cinder-volume[86896]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 07:42:43 devstack cinder-volume[86896]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 07:42:43 devstack cinder-volume[86896]: we strongly recommend against using it for new projects. Jul 10 07:42:43 devstack cinder-volume[86896]: If you are already using Eventlet, we recommend migrating to a different Jul 10 07:42:43 devstack cinder-volume[86896]: framework. For more detail see Jul 10 07:42:43 devstack cinder-volume[86896]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 07:42:43 devstack cinder-volume[86896]: import eventlet # noqa Jul 10 07:42:47 devstack cinder-volume[86896]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 07:42:47 devstack cinder-volume[86896]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 07:42:47 devstack cinder-volume[86896]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 07:42:48 devstack cinder-volume[86896]: INFO dbcounter [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Registered counter for database cinder Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG dbcounter [-] [86896] Writer thread running {{(pid=86896) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:42:48 devstack cinder-volume[86896]: INFO cinder.rpc [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 07:42:48 devstack cinder-volume[86896]: INFO cinder.rpc [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:48 devstack cinder-volume[86896]: INFO cinder.volume.manager [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Determined volume DB was empty at startup. Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG cinder.volume.manager [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86896) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 07:42:48 devstack cinder-volume[86896]: WARNING stevedore.named [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 07:42:48 devstack cinder-volume[86896]: WARNING castellan.key_manager [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:42:48 devstack cinder-volume[86896]: WARNING cinder.keymgr.conf_key_mgr [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 07:42:48 devstack cinder-volume[86896]: INFO cinder.volume.manager [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_db.sqlalchemy.engines [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:48 devstack cinder-volume[86896]: INFO oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Starting 1 workers Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Started child 87192 {{(pid=86896) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Full set of CONF: {{(pid=86896) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] ******************************************************************************** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] Configuration options gathered from: {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] ================================================================================ {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] allow_availability_zone_fallback = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] allow_compression_on_image_upload = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] allowed_direct_url_schemes = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] api_rate_limit = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] auth_strategy = keystone {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_availability_zone = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_host = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_stats_polling_interval = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backup_api_class = cinder.backup.api.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backup_name_template = backup-%s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[87192]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backup_use_same_host = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backup_use_temp_snapshot = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] chap_password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] chap_username = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_internal_tenant_project_id = 803baf903f5c4ad8854824a7de91b4e0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_internal_tenant_user_id = 8f0b5fcf8c4f45758d3b45f5c46a3693 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cluster = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] compression_format = gzip {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] config_dir = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] config_source = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] control_exchange = openstack {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] debug = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] default_availability_zone = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] default_group_type = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] default_volume_type = QuobyteHD {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] disk_geometry = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_client_cert = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_client_cert_key = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_data_namespace = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_ssl_cert_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_ssl_cert_verify = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] driver_use_ssl = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] enable_new_services = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] enable_unsupported_driver = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] enforce_multipath_for_image_xfer = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] filter_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_api_insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_api_ssl_compression = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_ca_certificates_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_num_retries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance_request_timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] goodness_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] graceful_shutdown_timeout = 5 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] group_api_class = cinder.group.api.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] host = devstack {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_compress_on_upload = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_conversion_address_space_limit = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:48 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_conversion_cpu_limit = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_conversion_disable = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_upload_use_cinder_backend = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_upload_use_internal_tenant = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_volume_cache_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_volume_cache_max_count = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] init_host_max_objects_retrieval = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] instance_format = [instance: %(uuid)s] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iscsi_target_flags = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iscsi_write_cache = on {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iser_helper = tgtadm {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iser_ip_address = 192.168.122.68 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iser_port = 3260 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_color = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_config_append = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_dir = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_options = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_rotate_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_rotate_interval_type = days {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] log_rotation_type = none {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] max_age = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] max_logfile_count = 30 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] max_logfile_size_mb = 200 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] max_over_subscription_ratio = 20.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] message_reap_interval = 86400 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] message_ttl = 2592000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] monkey_patch = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] monkey_patch_modules = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] my_ip = 192.168.122.68 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] no_snapshot_gb_quota = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] num_iser_scan_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] num_shell_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] num_volume_device_scan_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] nvmeof_conn_info_version = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] nvmet_ns_id = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] nvmet_port_id = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_max_limit = 1000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_ext_list = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_listen_port = 8776 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_use_ssl = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] osapi_volume_workers = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] per_volume_size_limit = -1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] periodic_fuzzy_delay = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] periodic_interval = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] public_endpoint = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] publish_errors = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_backup_gigabytes = 1000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_backups = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_gigabytes = 1000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_groups = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_snapshots = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] quota_volumes = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] rate_limit_burst = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] rate_limit_except_level = CRITICAL {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] rate_limit_interval = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] reinit_driver_count = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] replication_device = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] report_discard_supported = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] report_interval = 120 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] reservation_clean_interval = 86400 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] reservation_expire = 86400 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] reserved_image_namespaces = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] reserved_percentage = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] rpc_response_timeout = 120 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] run_external_periodic_tasks = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] scst_target_driver = iscsi {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] scst_target_iqn_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_down_time = 720 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] shell_completion = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] snapshot_name_template = snapshot-%s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] split_loggers = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] state_path = /opt/stack/data/cinder {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] storage_availability_zone = nova {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] storage_protocol = iSCSI {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] syslog_log_facility = LOG_USER {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_helper = lioadm {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_ip_address = 192.168.122.68 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_port = 3260 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_protocol = iscsi {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] target_secondary_ip_addresses = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] trace_flags = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] transport_url = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] until_refresh = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_chap_auth = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_default_quota_class = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_journal = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_json = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_multipath_for_image_xfer = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_stderr = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] use_syslog = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] verify_glance_signatures = enabled {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87192) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_api_class = cinder.volume.api.API {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_backend_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_clear = zero {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_clear_ionice = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_clear_size = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_copy_bps_limit = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_dd_blocksize = 1M {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_name_template = volume-%s {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_service_inithost_offload = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volume_usage_audit_period = month {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] zoning_mode = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.auth_section = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.auth_type = password {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.auth_version = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.cache = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.interface = public {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_password = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcache_username = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.region_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.service_type = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.backend = dogpile.cache.null {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.backend_argument = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.backend_expiration_time = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.config_prefix = cache.oslo {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.debug_cache_backend = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.enable_retry_client = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.enable_socket_keepalive = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.expiration_time = 600 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_dead_retry = 300 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_sasl_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.proxies = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.redis_db = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.redis_server = localhost:6379 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.retry_attempts = 2 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.retry_delay = 0.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.socket_keepalive_count = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.socket_keepalive_idle = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.socket_keepalive_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.socket_timeout = 1.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.tls_allowed_ciphers = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.tls_cafile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.tls_certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.tls_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.tls_keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cache.username = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] coordination.backend_url = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.asyncio_connection = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.asyncio_slave_connection = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.backend = sqlalchemy {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.connection = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.connection_debug = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.connection_parameters = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.connection_recycle_time = 3600 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.connection_trace = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.db_inc_retry_interval = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.db_max_retries = 20 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.db_max_retry_interval = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.db_retry_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.max_overflow = 50 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.max_pool_size = 5 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.max_retries = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.pool_timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.retry_interval = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.slave_connection = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.sqlite_synchronous = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.synchronous_reader = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] database.use_db_reconnect = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.connection_string = messaging:// {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.es_doc_type = notification {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.es_scroll_size = 10000 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.es_scroll_time = 2m {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.filter_error_trace = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.hmac_keys = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.sentinel_service_name = mymaster {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.socket_timeout = 0.1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.trace_requests = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler.trace_sqlalchemy = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler_jaeger.process_tags = {} {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] profiler_otlp.service_name_prefix = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.enforce_scope = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.policy_default_rule = default {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.group = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.helper_command = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] privsep_osbrick.user = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.group = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.helper_command = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] cinder_sys_admin.user = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.auth_section = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.auth_type = password {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.cafile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.collect_timing = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.send_service_user_token = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.split_loggers = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] service_user.timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.auth_section = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.auth_type = password {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.collect_timing = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.region_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.split_loggers = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] glance.timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.backend_availability_zone = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.chap_password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.chap_username = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.disk_geometry = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_client_cert = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_data_namespace = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.driver_use_ssl = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.extra_capabilities = {} {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.filter_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.goodness_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iscsi_target_flags = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iser_port = 3260 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_host = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_login = admin {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_mount_options = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_private_key = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_share_path = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.replication_device = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.report_discard_supported = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_helper = tgtadm {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_port = 3260 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_protocol = iscsi {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.trace_flags = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.use_chap_auth = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_backend_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_clear = zero {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87192) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 07:42:49 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_reports.file_event_handler = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_reports.log_dir = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Running cmd (subprocess): mount.quobyte {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.backend_host = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.chap_password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.chap_username = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.disk_geometry = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_client_cert = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.extra_capabilities = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.filter_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.goodness_function = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iser_helper = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iser_ip_address = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iser_port = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_host = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_login = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_mount_options = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_password = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_private_key = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_share_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.num_shell_tries = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.replication_device = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.report_discard_supported = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.reserved_percentage = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.scst_target_driver = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.storage_protocol = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_helper = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_ip_address = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_port = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_prefix = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_protocol = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.trace_flags = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.use_chap_auth = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_clear = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_clear_size = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] QuobyteHD.volumes_dir = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack quobyte-client[87193]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 07:42:49 devstack quobyte-client[87193]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_notifications.driver = [] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] key_manager.fixed_key = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.barbican_api_version = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.barbican_endpoint = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.barbican_endpoint_type = public {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.barbican_region_name = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.cafile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.collect_timing = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.number_of_retries = 60 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.retry_delay = 1 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.send_service_user_token = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.split_loggers = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.verify_ssl = True {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican.verify_ssl_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.auth_section = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.auth_type = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.cafile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.certfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.collect_timing = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.insecure = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.keyfile = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.split_loggers = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] barbican_service_user.timeout = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.approle_role_id = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.approle_secret_id = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.kv_mountpoint = secret {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.kv_path = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.kv_version = 2 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.namespace = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.root_token_id = **** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.ssl_ca_crt_file = None {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.timeout = 60.0 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.use_ssl = False {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 07:42:49 devstack cinder-volume[86896]: DEBUG oslo_service.backend._eventlet.service [None req-c9f8a204-ea76-41bd-b1e8-f5950313edd8 None None] ******************************************************************************** {{(pid=86896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 07:42:49 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:49 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:49 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:49 devstack cinder-volume[87192]: INFO cinder.volume.driver [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.driver [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writer thread running {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.db.api [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Building query based on filter {{(pid=87192) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87192) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:49 devstack cinder-volume[87192]: INFO cinder.keymgr.migration [None req-2143319a-e85c-4228-83e6-6d1879a90f73 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 07:42:49 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:49 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:50 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.644s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:42:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Driver initialization completed successfully. Jul 10 07:42:50 devstack cinder-volume[87192]: INFO cinder.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Initiating service 3 cleanup Jul 10 07:42:50 devstack cinder-volume[87192]: INFO cinder.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Service 3 cleanup completed. Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG cinder.service [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Creating RPC server for service cinder-volume {{(pid=87192) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG cinder.service [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87192) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 07:42:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:42:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:42:50 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:42:50 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:42:51 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Jul 10 07:42:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.636s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:42:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2c1528c-c49f-4704-b399-2cfd49f03b26 None None] Driver post RPC initialization completed successfully. Jul 10 07:42:58 devstack cinder-volume[86896]: DEBUG dbcounter [-] [86896] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86896) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:43:00 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:43:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=4 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:43:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:43:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 6 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:43:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Flow 'volume_create_manager' (4e91d504-3bc0-4c4c-af9b-ff7e26426273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b49e36-a53b-4072-a176-e18de190aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b49e36-a53b-4072-a176-e18de190aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1711186935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5f890-39f9-4f9c-b69d-284c71f0a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd274c97b745d2949602d26dfd8b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:43:50Z,use_quota=True,user_id='d920546d4f9741778307fd2cc76f3742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b88df2-89b1-468e-9134-ced5de780fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b88df2-89b1-468e-9134-ced5de780fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256caf2d-0964-44a3-b2eb-5f4a386672a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256caf2d-0964-44a3-b2eb-5f4a386672a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d5f890-39f9-4f9c-b69d-284c71f0a1a0', 'volume_name': 'volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f46652-f7cd-4cf2-bb3e-dae2cb2c5890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f46652-f7cd-4cf2-bb3e-dae2cb2c5890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dd1051-77f4-46a7-833c-e7b04a2b75b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Volume 01d5f890-39f9-4f9c-b69d-284c71f0a1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0', 'volume_size': 1} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1711186935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5f890-39f9-4f9c-b69d-284c71f0a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd274c97b745d2949602d26dfd8b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:43:50Z,use_quota=True,user_id='d920546d4f9741778307fd2cc76f3742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Creating volume 01d5f890-39f9-4f9c-b69d-284c71f0a1a0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:43:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:43:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:43:49 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 1073741824 Jul 10 07:43:49 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:43:51 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 1073741824" returned: 0 in 1.202s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:43:51 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 Jul 10 07:43:51 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:43:51 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" returned: 0 in 0.781s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dd1051-77f4-46a7-833c-e7b04a2b75b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d3f1d1-2139-4d44-bf6e-7af5173b830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:43:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Volume volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 (01d5f890-39f9-4f9c-b69d-284c71f0a1a0): created successfully Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d3f1d1-2139-4d44-bf6e-7af5173b830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:43:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Flow 'volume_create_manager' (4e91d504-3bc0-4c4c-af9b-ff7e26426273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:43:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-46ab243e-7e57-4981-9d60-4727cb784d10 tempest-TaggedAttachmentsTest-1607321764 None] Created volume successfully. Jul 10 07:44:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:44:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Flow 'volume_create_manager' (deb75f1b-6d97-4319-9058-eafbb3015e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43a9b00-1e5a-4bea-b499-440da585aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43a9b00-1e5a-4bea-b499-440da585aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1233474823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0193ffeb2a834b98a2221f25f017d352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:44:23Z,use_quota=True,user_id='eb9d9940451846c7bf49da94e8908ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf06eede-1c62-4060-8a52-c1832f8f3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf06eede-1c62-4060-8a52-c1832f8f3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877464c-91ce-400f-85b2-67ffee3d4576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877464c-91ce-400f-85b2-67ffee3d4576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5', 'volume_name': 'volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e79e3d-2299-4911-a017-c1b19e2fcbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e79e3d-2299-4911-a017-c1b19e2fcbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0557d3-98d4-47ea-87d6-15aeec0cf40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Volume 4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5', 'volume_size': 1} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1233474823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0193ffeb2a834b98a2221f25f017d352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:44:23Z,use_quota=True,user_id='eb9d9940451846c7bf49da94e8908ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Creating volume 4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:44:22 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:44:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:22 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 1073741824 Jul 10 07:44:22 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:24 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 1073741824" returned: 0 in 1.460s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:24 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 Jul 10 07:44:24 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:25 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0557d3-98d4-47ea-87d6-15aeec0cf40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ae275e-45fe-485e-a198-0a43b46e0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Volume volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 (4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5): created successfully Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ae275e-45fe-485e-a198-0a43b46e0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Flow 'volume_create_manager' (deb75f1b-6d97-4319-9058-eafbb3015e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:44:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a982ce67-5463-4aed-80bf-867d289a89c1 tempest-VolumesAdminNegativeTest-1433474515 None] Created volume successfully. Jul 10 07:44:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Acquiring lock "cinder-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:44:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "cinder-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:44:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Acquiring lock "cinder-quobyte-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:44:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "cinder-quobyte-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" acquired by "delete_volume" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:44:27 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp04c0aava/privsep.sock'] Jul 10 07:44:27 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp04c0aava/privsep.sock Jul 10 07:44:27 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 07:44:28 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 07:44:30 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 07:44:30 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:31 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Spawned new privsep daemon via rootwrap Jul 10 07:44:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Accepted privsep connection to /tmp/tmp04c0aava/privsep.sock {{(pid=87192) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 07:44:31 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 07:44:31 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 07:44:31 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 07:44:31 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88292 Jul 10 07:44:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4034e0-00d6-42a4-a268-19849eaae1fd]: (2,) {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:44:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[43075088-5bf3-40d9-b56a-41b51ccf1187]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:44:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:31 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 Jul 10 07:44:31 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Flow 'volume_create_manager' (434c8eee-f38d-42a8-84a4-cc2a71e828fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:44:33 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0794ae6e-704c-423a-b04f-887af090d385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" returned: 0 in 2.573s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:33 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5 Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0794ae6e-704c-423a-b04f-887af090d385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2083547771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd2eff5-07d0-469e-8a28-3828356e050b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4631ce2e006645b2a8683f4b5871914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:44:33Z,use_quota=True,user_id='9ef780fff07943d28dfd1f9f9154308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:33 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608fc182-cffd-4b4d-bff2-121bb4381fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608fc182-cffd-4b4d-bff2-121bb4381fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918e176c-a81e-4e38-8516-f08ed180e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918e176c-a81e-4e38-8516-f08ed180e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd2eff5-07d0-469e-8a28-3828356e050b', 'volume_name': 'volume-8dd2eff5-07d0-469e-8a28-3828356e050b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853cacb4-d7fc-4eae-bf2e-eeae0b4b015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853cacb4-d7fc-4eae-bf2e-eeae0b4b015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa49aa2-bff9-46bf-af86-a8f91ed2cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Volume 8dd2eff5-07d0-469e-8a28-3828356e050b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd2eff5-07d0-469e-8a28-3828356e050b', 'volume_size': 1} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2083547771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd2eff5-07d0-469e-8a28-3828356e050b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4631ce2e006645b2a8683f4b5871914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:44:33Z,use_quota=True,user_id='9ef780fff07943d28dfd1f9f9154308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Creating volume 8dd2eff5-07d0-469e-8a28-3828356e050b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:44:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:44:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:33 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b 1073741824 Jul 10 07:44:33 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:35 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" returned: 0 in 1.515s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:35 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b 1073741824" returned: 0 in 1.409s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "cinder-quobyte-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5" released by "delete_volume" :: held 7.699s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:44:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:35 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b Jul 10 07:44:35 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:35 devstack cinder-volume[87192]: WARNING cinder.quota [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:44:35 devstack cinder-volume[87192]: WARNING cinder.quota [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:44:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Created reservations ['5a69df97-258b-465e-a255-2f83c28235a6', 'bf3468b3-c0a1-456f-aa74-12e111ecb6e7', 'aa0b2093-bd1d-4f23-8ff3-cb36d9a97146', '5ce65068-a5f1-4651-9d78-b274abeef0ef'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:36 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:44:36 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:44:36 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:44:36 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:44:36 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b" returned: 0 in 1.540s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] <== create_volume: return (3175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.183s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:44:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa49aa2-bff9-46bf-af86-a8f91ed2cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd2eff5-07d0-469e-8a28-3828356e050b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ab731-a776-41d8-b00d-6820cd465c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:44:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Volume volume-8dd2eff5-07d0-469e-8a28-3828356e050b (8dd2eff5-07d0-469e-8a28-3828356e050b): created successfully Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ab731-a776-41d8-b00d-6820cd465c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Flow 'volume_create_manager' (434c8eee-f38d-42a8-84a4-cc2a71e828fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:44:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a342abc-21ad-4207-9c12-dffbc1e8cdf8 tempest-ServerRescueNegativeTestJSON-1443966443 None] Created volume successfully. Jul 10 07:44:37 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.064s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:44:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:44:38 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Jul 10 07:44:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 2.464s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:44:38 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:44:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Deleted volume successfully. Jul 10 07:44:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-76d15859-3b0d-4165-b09b-568078e5664f tempest-VolumesAdminNegativeTest-1433474515 None] Lock "cinder-4eff7343-7bde-4c7c-a1c4-a6e0bcd906f5-delete_volume" released by "delete_volume" :: held 11.239s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:44:47 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=17,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:44:48 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Acquiring lock "cinder-8dd2eff5-07d0-469e-8a28-3828356e050b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "cinder-8dd2eff5-07d0-469e-8a28-3828356e050b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Acquiring lock "cinder-quobyte-8dd2eff5-07d0-469e-8a28-3828356e050b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "cinder-quobyte-8dd2eff5-07d0-469e-8a28-3828356e050b" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1f249-08e3-4b9e-8229-fc76a6e83b86]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:45:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:01 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b Jul 10 07:45:01 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:02 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b" returned: 0 in 1.115s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:02 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b Jul 10 07:45:02 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:03 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8dd2eff5-07d0-469e-8a28-3828356e050b" returned: 0 in 0.999s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "cinder-quobyte-8dd2eff5-07d0-469e-8a28-3828356e050b" released by "delete_volume" :: held 2.188s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:45:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Created reservations ['7851036a-ce8b-449b-9d6f-995ddd3d3859', '2ab08a24-d3da-43aa-b803-377afe48d935', 'a2fcde45-e8d8-4ed3-bbf9-2684bfe72f54', 'f7ba48a4-1ea4-481f-a338-08c4ea480741'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:04 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:45:04 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:05 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.309s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:45:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Deleted volume successfully. Jul 10 07:45:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-961e54ee-b86c-43a1-be3f-d73c2c951cc0 tempest-ServerRescueNegativeTestJSON-1443966443 None] Lock "cinder-8dd2eff5-07d0-469e-8a28-3828356e050b-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:45:14 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:15 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Flow 'volume_create_manager' (cc9c7bad-ebd0-42ec-a7c6-4246e4e98fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4067bbe-a6c1-45ba-bd02-7e6cd8d7dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4067bbe-a6c1-45ba-bd02-7e6cd8d7dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1637529366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418eb5a-be2b-4f1c-a146-831e41d6d24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c4e5fe77c748c49095776cca68bffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:45:29Z,use_quota=True,user_id='f603b1267f504ee6a7a78f726028e95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde85ec0-6b68-4b1e-ab0d-95f170a40499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde85ec0-6b68-4b1e-ab0d-95f170a40499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6708e9e-8609-4959-bcde-522c142ce983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6708e9e-8609-4959-bcde-522c142ce983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'volume_name': 'volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ae4f8-4081-4815-a451-91ff756727a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ae4f8-4081-4815-a451-91ff756727a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20a753d-011c-4a32-94a9-e9f276dba669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Volume f418eb5a-be2b-4f1c-a146-831e41d6d24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'volume_size': 1} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1637529366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418eb5a-be2b-4f1c-a146-831e41d6d24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c4e5fe77c748c49095776cca68bffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:45:29Z,use_quota=True,user_id='f603b1267f504ee6a7a78f726028e95e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Creating volume f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:45:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:45:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:29 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e 1073741824 Jul 10 07:45:29 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:30 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e 1073741824" returned: 0 in 1.144s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:30 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e Jul 10 07:45:30 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:30 devstack cinder-volume[87192]: WARNING py.warnings [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 10 07:45:30 devstack cinder-volume[87192]: .first() Jul 10 07:45:30 devstack cinder-volume[87192]: Jul 10 07:45:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:31 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.879s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20a753d-011c-4a32-94a9-e9f276dba669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c46b65f-4fca-4560-a120-183af9a4d044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a41d4f-96cd-434b-a8ae-fa8e62bb259b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Volume volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e (f418eb5a-be2b-4f1c-a146-831e41d6d24e): created successfully Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c46b65f-4fca-4560-a120-183af9a4d044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Flow 'volume_create_manager' (cc9c7bad-ebd0-42ec-a7c6-4246e4e98fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:45:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-812d6057-117b-4082-9d38-109dc3c576a3 tempest-ServerActionsTestOtherA-1371437059 None] Created volume successfully. Jul 10 07:45:31 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 Jul 10 07:45:31 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:32 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" returned: 0 in 1.013s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.041s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '425112cb-e8d2-48aa-87bb-afdefe8eadfd', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:45:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-53f0af64-354c-4522-b02b-8046458f203e req-185c9bc1-ffdd-4b46-8608-08904907e77d tempest-TaggedAttachmentsTest-1607321764 None] attachment_update completed successfully. Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:36 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:45:36 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Flow 'volume_create_manager' (2f1265aa-8007-4451-a3a8-157eb6a0df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:45:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cfbfb8-da11-4f0a-938c-2c77b6fa2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cfbfb8-da11-4f0a-938c-2c77b6fa2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-52658038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee81a78-164e-4d61-a031-5065d566a092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5871f8efd3a94a159ab0b8f4dfb27a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:45:37Z,use_quota=True,user_id='f8f4e05313744f53aa964da7ab5e0452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065c39ae-b9cb-44c5-9275-8f66054cce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065c39ae-b9cb-44c5-9275-8f66054cce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a29249-ae9c-4bd0-881a-2b87f07e81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a29249-ae9c-4bd0-881a-2b87f07e81ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee81a78-164e-4d61-a031-5065d566a092', 'volume_name': 'volume-5ee81a78-164e-4d61-a031-5065d566a092', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e863b125-42cd-46d9-a4cc-28dfc2f5193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e863b125-42cd-46d9-a4cc-28dfc2f5193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef75dd-5aad-48ce-8259-8a00b1d984a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Volume 5ee81a78-164e-4d61-a031-5065d566a092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee81a78-164e-4d61-a031-5065d566a092', 'volume_size': 1} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-52658038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee81a78-164e-4d61-a031-5065d566a092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5871f8efd3a94a159ab0b8f4dfb27a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:45:37Z,use_quota=True,user_id='f8f4e05313744f53aa964da7ab5e0452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Creating volume 5ee81a78-164e-4d61-a031-5065d566a092 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:45:37 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:37 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 1073741824 Jul 10 07:45:37 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:37 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.492s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:45:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:45:38 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 1073741824" returned: 0 in 1.406s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:38 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 Jul 10 07:45:38 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:40 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092" returned: 0 in 1.476s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] <== create_volume: return (2950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.954s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef75dd-5aad-48ce-8259-8a00b1d984a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee81a78-164e-4d61-a031-5065d566a092', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9831e2-0cee-4b32-acc5-2ec0dc2e0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:45:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Volume volume-5ee81a78-164e-4d61-a031-5065d566a092 (5ee81a78-164e-4d61-a031-5065d566a092): created successfully Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9831e2-0cee-4b32-acc5-2ec0dc2e0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:45:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Flow 'volume_create_manager' (2f1265aa-8007-4451-a3a8-157eb6a0df8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:45:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8a8602d5-32a7-4ac4-b38d-c01bcf6fc6b7 tempest-DeleteServersTestJSON-1269997583 None] Created volume successfully. Jul 10 07:45:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-a99caa51-8321-4859-a258-c7fd3f09db2d req-d695996b-7f8c-4a19-b816-da8f3ecb0148 tempest-TaggedAttachmentsTest-1607321764 None] Terminate volume connection completed successfully. Jul 10 07:45:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-a99caa51-8321-4859-a258-c7fd3f09db2d req-d695996b-7f8c-4a19-b816-da8f3ecb0148 tempest-TaggedAttachmentsTest-1607321764 None] Deleting attachment 425112cb-e8d2-48aa-87bb-afdefe8eadfd. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:45:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:45:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:45:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6a1cd7-5e60-44a5-b258-4a300772e9ba]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:45:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:45:45 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 Jul 10 07:45:45 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:45:46 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Jul 10 07:45:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092" returned: 0 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:45:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:45:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-5ee81a78-164e-4d61-a031-5065d566a092', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50bd1607-dce0-4d20-99e7-121c5b9d14a7', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:45:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1ae8e794-e4d0-44d1-a78c-efc12c0bb000 req-ce79925d-c99b-42ec-b672-559870684038 tempest-DeleteServersTestJSON-1269997583 None] attachment_update completed successfully. Jul 10 07:45:56 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=11,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:56 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:45:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-8e685465-2973-440f-a187-6e6b313ffd2e req-7d01909a-f1f3-45c1-97c5-75af7552508e tempest-DeleteServersTestJSON-1269997583 None] Terminate volume connection completed successfully. Jul 10 07:45:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-8e685465-2973-440f-a187-6e6b313ffd2e req-7d01909a-f1f3-45c1-97c5-75af7552508e tempest-DeleteServersTestJSON-1269997583 None] Deleting attachment 50bd1607-dce0-4d20-99e7-121c5b9d14a7. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:46:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "cinder-5ee81a78-164e-4d61-a031-5065d566a092-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "cinder-5ee81a78-164e-4d61-a031-5065d566a092-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "cinder-quobyte-5ee81a78-164e-4d61-a031-5065d566a092" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "cinder-quobyte-5ee81a78-164e-4d61-a031-5065d566a092" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d37b3-a1d4-458b-baea-b9a6a7d11c0a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:02 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 Jul 10 07:46:02 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:03 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092" returned: 0 in 1.622s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:03 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092 Jul 10 07:46:03 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:04 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5ee81a78-164e-4d61-a031-5065d566a092" returned: 0 in 1.154s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "cinder-quobyte-5ee81a78-164e-4d61-a031-5065d566a092" released by "delete_volume" :: held 2.857s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Created reservations ['954273be-b799-4fe6-9899-d0f62ff72af1', 'c056ca9e-dbf9-45bb-b285-990b388ab36f', 'fcf4532a-9e5f-4b95-962c-b4a8c824c557', 'c3b87051-4b1c-4b26-8e22-b6ae70c28890'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:05 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:46:05 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:05 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.874s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:46:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Deleted volume successfully. Jul 10 07:46:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6d5c3d21-261d-4e43-95ef-f80aea37a078 tempest-DeleteServersTestJSON-1269997583 None] Lock "cinder-5ee81a78-164e-4d61-a031-5065d566a092-delete_volume" released by "delete_volume" :: held 4.131s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "cinder-01d5f890-39f9-4f9c-b69d-284c71f0a1a0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "cinder-01d5f890-39f9-4f9c-b69d-284c71f0a1a0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "cinder-quobyte-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "cinder-quobyte-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eba045-73e9-4096-845a-1e9667ee1e5e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:06 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 Jul 10 07:46:06 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:07 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:07 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0 Jul 10 07:46:07 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:08 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "cinder-quobyte-01d5f890-39f9-4f9c-b69d-284c71f0a1a0" released by "delete_volume" :: held 1.681s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Created reservations ['101d29e7-d5d7-4098-8f24-3f63bfea4c9a', '572f65e5-52ad-4054-a6e3-37c863016583', 'fd66b450-568f-400c-9678-9e8b4c786622', 'bf045a01-3da4-4a5c-abe1-3acb634bb3f3'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:08 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:46:08 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:09 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:09 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:46:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Deleted volume successfully. Jul 10 07:46:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c6769745-c9de-4d05-88cb-d66b3ef6e830 tempest-TaggedAttachmentsTest-1607321764 None] Lock "cinder-01d5f890-39f9-4f9c-b69d-284c71f0a1a0-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51ddb1a6-4502-4c16-9c12-7155c5692bb1 tempest-GroupsV314Test-2077336607 None] Group tempest-GroupsV314Test-Group-1962686423: creating Jul 10 07:46:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51ddb1a6-4502-4c16-9c12-7155c5692bb1 tempest-GroupsV314Test-2077336607 None] Group tempest-GroupsV314Test-Group-1962686423: created successfully Jul 10 07:46:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51ddb1a6-4502-4c16-9c12-7155c5692bb1 tempest-GroupsV314Test-2077336607 None] Create group completed successfully. Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Flow 'volume_create_manager' (f43e0946-0af1-4c0a-aab8-29a0027ed4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173a77a8-9109-4049-b9a0-553bac2a255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173a77a8-9109-4049-b9a0-553bac2a255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830038225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa17c82a-6428-4729-8ca6-8b0dbc290cc8,host='devstack@QuobyteHD#QuobyteHD',id=b635a80e-4c38-4963-be39-f8879afe94fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d549cb3d18495681be49b9a7c5084b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:46:16Z,use_quota=True,user_id='b891e0baf5454dea963da3bc92f11541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d80e50b3-6a86-4043-a72c-9586b979c222),volume_type_id=d80e50b3-6a86-4043-a72c-9586b979c222)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad4e4f0-05d0-40a8-a37c-e4a4bc6bcc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad4e4f0-05d0-40a8-a37c-e4a4bc6bcc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3abc7-3cdb-4999-9e43-963c47ef167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3abc7-3cdb-4999-9e43-963c47ef167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b635a80e-4c38-4963-be39-f8879afe94fe', 'volume_name': 'volume-b635a80e-4c38-4963-be39-f8879afe94fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fda457c-6c72-43be-a730-ae00a22dd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fda457c-6c72-43be-a730-ae00a22dd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069a8ba1-de4d-4371-b3c0-ef2a488fa217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Volume b635a80e-4c38-4963-be39-f8879afe94fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b635a80e-4c38-4963-be39-f8879afe94fe', 'volume_size': 1} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa17c82a-6428-4729-8ca6-8b0dbc290cc8,created_at=2026-07-10T05:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830038225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa17c82a-6428-4729-8ca6-8b0dbc290cc8,host='devstack@QuobyteHD#QuobyteHD',id=b635a80e-4c38-4963-be39-f8879afe94fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d549cb3d18495681be49b9a7c5084b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:46:16Z,use_quota=True,user_id='b891e0baf5454dea963da3bc92f11541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d80e50b3-6a86-4043-a72c-9586b979c222),volume_type_id=d80e50b3-6a86-4043-a72c-9586b979c222)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Creating volume b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:46:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:46:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:16 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe 1073741824 Jul 10 07:46:16 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:17 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe 1073741824" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:17 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:17 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:18 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.675s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069a8ba1-de4d-4371-b3c0-ef2a488fa217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b635a80e-4c38-4963-be39-f8879afe94fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1436cc02-2bc7-4fca-a30b-ac1cd82570ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Volume volume-b635a80e-4c38-4963-be39-f8879afe94fe (b635a80e-4c38-4963-be39-f8879afe94fe): created successfully Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1436cc02-2bc7-4fca-a30b-ac1cd82570ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Flow 'volume_create_manager' (f43e0946-0af1-4c0a-aab8-29a0027ed4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:46:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9ecb34d8-b030-423f-8aa0-30b3ef594349 tempest-GroupsV314Test-2077336607 None] Created volume successfully. Jul 10 07:46:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a473030-bc1e-4566-a5bf-cad0e780bc6b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:19 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e Jul 10 07:46:19 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:20 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.132s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Cloning volume b635a80e-4c38-4963-be39-f8879afe94fe to volume 3af18f93-e215-4415-878b-98f9ca8ada47 Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d7442e-8d6f-4ebc-8a0c-a7ddba0c9232', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Creating offline snapshot d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 of volume b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8580d92-5cb1-4914-8451-015a1ddbbb06]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-40dbc204-586f-41ff-8ec6-6cc393937f02 req-eb6f6267-56f2-4b9e-bb1b-2f627b5649f7 tempest-ServerActionsTestOtherA-1371437059 None] attachment_update completed successfully. Jul 10 07:46:20 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:20 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:21 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:21 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 1G Jul 10 07:46:21 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:21 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 1G" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b635a80e-4c38-4963-be39-f8879afe94fe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:21 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b635a80e-4c38-4963-be39-f8879afe94fe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:21 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:22 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b635a80e-4c38-4963-be39-f8879afe94fe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.881s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:46:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:22 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:22 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:23 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:23 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info Jul 10 07:46:23 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:24 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:24 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:46:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:24 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info Jul 10 07:46:24 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:25 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.info" returned: 0 in 0.846s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Acquiring lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] snapshot: d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7, volume: 3af18f93-e215-4415-878b-98f9ca8ada47, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ce7ed-d034-4f7f-b4e9-798a9a1cc8dd]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:25 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:25 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:26 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b635a80e-4c38-4963-be39-f8879afe94fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7993ab-147d-400e-a48f-8575bc0a1698]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:26 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:26 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (db34c697-c206-4d49-ab8d-f21adaedb17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b28ced-7691-47e3-a504-34c7d138a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b28ced-7691-47e3-a504-34c7d138a833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1029577041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7284ce-c469-4d54-ae5b-371f72b9311a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:46:27Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319acde-48ca-401d-93d8-b8c92c8da926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319acde-48ca-401d-93d8-b8c92c8da926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eb2e15-384b-47bb-b218-b5afd4d8d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eb2e15-384b-47bb-b218-b5afd4d8d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7284ce-c469-4d54-ae5b-371f72b9311a', 'volume_name': 'volume-8a7284ce-c469-4d54-ae5b-371f72b9311a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c641d60-308a-47a9-9e42-222aab54772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c641d60-308a-47a9-9e42-222aab54772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0030a7b-7677-4a67-a88f-755c3a7e1a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Volume 8a7284ce-c469-4d54-ae5b-371f72b9311a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7284ce-c469-4d54-ae5b-371f72b9311a', 'volume_size': 1} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:27 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 1.246s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:46:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:27 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 Jul 10 07:46:27 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-ced6c47b-fc44-40d2-a0d8-f8103b90dd06 tempest-ServerActionsTestOtherA-1371437059 None] Terminate volume connection completed successfully. Jul 10 07:46:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-ced6c47b-fc44-40d2-a0d8-f8103b90dd06 tempest-ServerActionsTestOtherA-1371437059 None] Deleting attachment 21d7442e-8d6f-4ebc-8a0c-a7ddba0c9232. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:46:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:34 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47" returned: 0 in 6.891s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a677b4-14af-4bdc-a232-7b280af611e8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:34 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:34 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:35 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.941s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:46:35 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Converted 1024.00 MB image at 148.59 MB/s Jul 10 07:46:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:35 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 Jul 10 07:46:35 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:35 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" released by "_copy_volume_from_snapshot" :: held 10.717s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Acquiring lock "cinder-quobyte-d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Deleting offline snapshot d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 of volume b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] snapshot_file for this snap is: volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72ea8d-178a-401b-a40a-b2b2a95f3ce0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:36 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:36 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:36 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:46:36 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:36 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b635a80e-4c38-4963-be39-f8879afe94fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9e1a7-61a7-4dbb-ba51-593ff52c66fe]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:36 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:36 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:37 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:46:37 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:37 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:37 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:38 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:38 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7 Jul 10 07:46:38 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:38 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe.d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-d7e4170a-daa1-4c3b-ab6e-10cdeba5d8a7" released by "_delete_snapshot" :: held 3.003s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.897s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.797s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1029577041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7284ce-c469-4d54-ae5b-371f72b9311a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:46:27Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Creating volume 8a7284ce-c469-4d54-ae5b-371f72b9311a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:46:38 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:46:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:39 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a 1073741824 Jul 10 07:46:39 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dcdf971a-442d-4aaa-ae69-d30f0e9a14d3 tempest-GroupsV314Test-2077336607 None] Create group from source-group-fa17c82a-6428-4729-8ca6-8b0dbc290cc8 completed successfully. Jul 10 07:46:39 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a 1073741824" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:39 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a Jul 10 07:46:39 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Acquiring lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a9c5ed-6dc1-4629-9678-36d2f1e3c9ce]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:40 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 Jul 10 07:46:40 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:40 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.800s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60f462-9baa-423d-82af-9d4877c00ffe]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0030a7b-7677-4a67-a88f-755c3a7e1a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7284ce-c469-4d54-ae5b-371f72b9311a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503909a9-f6d7-479e-8fcb-04abb318a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:46:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Volume volume-8a7284ce-c469-4d54-ae5b-371f72b9311a (8a7284ce-c469-4d54-ae5b-371f72b9311a): created successfully Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503909a9-f6d7-479e-8fcb-04abb318a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:46:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (db34c697-c206-4d49-ab8d-f21adaedb17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:46:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0b5c221d-2d65-4d7e-bc9d-528488e00c4f tempest-AttachVolumeNegativeTest-1771272357 None] Created volume successfully. Jul 10 07:46:41 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e Jul 10 07:46:41 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:41 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47" returned: 0 in 1.162s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:41 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47 Jul 10 07:46:41 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:41 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e" returned: 0 in 1.013s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32804a2e-37d1-4da9-b597-5b6d2189c67d', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:46:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-08e75a00-8fe5-46e5-815f-f905c453bc73 req-c39d9dd6-1b9f-45ba-ab43-a20c5c3a20ce tempest-ServerActionsTestOtherA-1371437059 None] attachment_update completed successfully. Jul 10 07:46:42 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3af18f93-e215-4415-878b-98f9ca8ada47" returned: 0 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-3af18f93-e215-4415-878b-98f9ca8ada47" released by "delete_volume" :: held 2.097s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Created reservations ['247c1c14-9e56-4086-841b-32afc0a5b85c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:42 devstack cinder-volume[87192]: WARNING cinder.quota [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-558530765 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-558530765, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:46:42 devstack cinder-volume[87192]: WARNING cinder.quota [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-558530765 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-558530765, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Created reservations ['e91fccb6-2858-475c-8ab4-cb693ace56a1', 'ca0fec54-9ce0-49ba-833b-7e15ba4efa4d', 'a6cdcaf2-02da-4ed4-aadd-17551e6aa968', '090dc766-b7bc-4fb1-9b6d-d1295bc1f309'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:42 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:46:42 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:43 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:46:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-41ac66f8-3fbe-407c-8598-b5a8dd1209d0 tempest-GroupsV314Test-2077336607 None] Delete group completed successfully. Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Acquiring lock "cinder-quobyte-b635a80e-4c38-4963-be39-f8879afe94fe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-b635a80e-4c38-4963-be39-f8879afe94fe" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[03653986-481d-4426-84ea-e2dc0f00552f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:43 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:43 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:44 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.835s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:44 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe Jul 10 07:46:44 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[526f5130-390f-4af1-80ef-e2c5878a74ab]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:45 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b635a80e-4c38-4963-be39-f8879afe94fe" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:45 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a Jul 10 07:46:45 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Lock "cinder-quobyte-b635a80e-4c38-4963-be39-f8879afe94fe" released by "delete_volume" :: held 1.625s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Created reservations ['df6eb022-a18b-49bd-90bb-1a1e95590554'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Created reservations ['f15d4559-f3ed-463b-b073-42f40cc716b0', 'ea8b2297-ddc9-4e0f-b63b-11b6ba97cfad', 'f887ef71-0db1-4ac7-80ec-4a68e7190a73', 'fc642134-95a7-4fb0-ab27-a4867dd2b01a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:46:45 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:46:45 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:46:46 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a" returned: 0 in 1.533s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.558s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:46:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-8a7284ce-c469-4d54-ae5b-371f72b9311a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49485d56-ac56-4135-8c68-f02bd1f60fe2', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:46:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f03907fe-9525-43dc-b1da-09ac5ef6f672 req-6f73a793-2aea-4fc6-80fa-a1ab701debb0 tempest-AttachVolumeNegativeTest-1771272357 None] attachment_update completed successfully. Jul 10 07:46:47 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 10 07:46:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.387s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:46:47 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:46:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a3b7b2b-6c6b-40e3-a4c3-fbd6f1934be9 tempest-GroupsV314Test-2077336607 None] Delete group completed successfully. Jul 10 07:47:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=60,cinder:INSERT=8,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:47:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=56,cinder:UPDATE=48,cinder:INSERT=14 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Flow 'volume_create_manager' (16db656b-d345-46cc-8069-a34d4322ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8750e97e-3e5c-4bf8-b13f-804d960b6d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8750e97e-3e5c-4bf8-b13f-804d960b6d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-59168124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54417205-3c5c-4e9d-a6e3-1d1ddfa57179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18ba8dfc8e2485d8720315014e6dafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:12Z,use_quota=True,user_id='eee9b47554454fe89ed164b9702fbbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a41b84b-e2ae-4d2b-880f-733278eeae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a41b84b-e2ae-4d2b-880f-733278eeae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4d447b-3004-40cb-aa07-9ad0c2417d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4d447b-3004-40cb-aa07-9ad0c2417d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54417205-3c5c-4e9d-a6e3-1d1ddfa57179', 'volume_name': 'volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f365d9-0da8-40f2-bde9-6e4957600483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f365d9-0da8-40f2-bde9-6e4957600483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70828f9-0302-487c-a96b-719242112141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Volume 54417205-3c5c-4e9d-a6e3-1d1ddfa57179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179', 'volume_size': 1} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-59168124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54417205-3c5c-4e9d-a6e3-1d1ddfa57179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c18ba8dfc8e2485d8720315014e6dafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:12Z,use_quota=True,user_id='eee9b47554454fe89ed164b9702fbbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Creating volume 54417205-3c5c-4e9d-a6e3-1d1ddfa57179 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:47:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:47:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:11 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 1073741824 Jul 10 07:47:11 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:13 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 1073741824" returned: 0 in 1.349s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:13 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 Jul 10 07:47:13 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:14 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" returned: 0 in 1.269s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] <== create_volume: return (2721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.724s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70828f9-0302-487c-a96b-719242112141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e8f79a-bbfd-4194-ab35-a3edaf099759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Volume volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 (54417205-3c5c-4e9d-a6e3-1d1ddfa57179): created successfully Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e8f79a-bbfd-4194-ab35-a3edaf099759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Flow 'volume_create_manager' (16db656b-d345-46cc-8069-a34d4322ecec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eb7e4a6f-176b-4db8-84b8-078a6d2fc0a9 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Created volume successfully. Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Acquiring lock "cinder-54417205-3c5c-4e9d-a6e3-1d1ddfa57179-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "cinder-54417205-3c5c-4e9d-a6e3-1d1ddfa57179-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Acquiring lock "cinder-quobyte-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "cinder-quobyte-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f418fc-36b3-410b-bfac-7503a0238de9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:47:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:16 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 Jul 10 07:47:16 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:17 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:17 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179 Jul 10 07:47:17 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:18 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "cinder-quobyte-54417205-3c5c-4e9d-a6e3-1d1ddfa57179" released by "delete_volume" :: held 1.881s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Created reservations ['8fea3809-c4df-4afe-8f91-b86969af0f79', '48cd496b-45a1-45c9-8758-18c9eb655fa5', '7bd61191-c3f2-4fdd-b895-5c52215ca052', '11f89dc1-bfaf-4e5f-bc2f-616ddb36d817'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:18 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:18 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:19 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:19 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Deleted volume successfully. Jul 10 07:47:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11de6b77-3d89-4877-85e0-a272b10a75a4 tempest-VolumeQuotasNegativeTestJSON-1817185151 None] Lock "cinder-54417205-3c5c-4e9d-a6e3-1d1ddfa57179-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Flow 'volume_create_manager' (5e4408eb-135a-4a9e-a6ac-42bc28fc1dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc07f9ab-cd98-40d3-8075-6c67d5fe953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc07f9ab-cd98-40d3-8075-6c67d5fe953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1499626319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa8ba53-9caa-4090-946b-37e038a1c959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8aa9fff436f4f87bd6b63212994dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:20Z,use_quota=True,user_id='49dda9d96c2743a4ac68a65d7ca122a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696d69f5-ee0a-4a39-8808-5e0100b9151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696d69f5-ee0a-4a39-8808-5e0100b9151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0d8108-1070-47a1-ab51-e4f7a2458790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0d8108-1070-47a1-ab51-e4f7a2458790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa8ba53-9caa-4090-946b-37e038a1c959', 'volume_name': 'volume-3aa8ba53-9caa-4090-946b-37e038a1c959', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ee2678-988a-4790-9840-6f3753418b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ee2678-988a-4790-9840-6f3753418b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c059db-fb16-48ae-a337-c7b32995424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Volume 3aa8ba53-9caa-4090-946b-37e038a1c959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa8ba53-9caa-4090-946b-37e038a1c959', 'volume_size': 1} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1499626319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa8ba53-9caa-4090-946b-37e038a1c959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8aa9fff436f4f87bd6b63212994dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:20Z,use_quota=True,user_id='49dda9d96c2743a4ac68a65d7ca122a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Creating volume 3aa8ba53-9caa-4090-946b-37e038a1c959 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:47:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:47:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:20 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 1073741824 Jul 10 07:47:20 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:21 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 1073741824" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:21 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 Jul 10 07:47:21 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:22 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c059db-fb16-48ae-a337-c7b32995424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa8ba53-9caa-4090-946b-37e038a1c959', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a712f75-4db9-4934-bab7-93b587e437bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Volume volume-3aa8ba53-9caa-4090-946b-37e038a1c959 (3aa8ba53-9caa-4090-946b-37e038a1c959): created successfully Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a712f75-4db9-4934-bab7-93b587e437bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Flow 'volume_create_manager' (5e4408eb-135a-4a9e-a6ac-42bc28fc1dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06d8cc51-e932-4e44-b53f-1ee19e82b227 tempest-ServersNegativeTestJSON-1191495202 None] Created volume successfully. Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Flow 'volume_create_manager' (4fbc1942-d5d3-4292-8600-150ef58fb655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71597f-69b8-4d9c-8a5f-8ba2d5a20a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71597f-69b8-4d9c-8a5f-8ba2d5a20a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-493838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0c79be-282b-4165-8c96-6d400ed4e1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8aa9fff436f4f87bd6b63212994dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:24Z,use_quota=True,user_id='49dda9d96c2743a4ac68a65d7ca122a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798e7162-c409-4b4e-b1e7-924b331b2d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798e7162-c409-4b4e-b1e7-924b331b2d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fdf172-a197-4462-93aa-e6638fe8d06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fdf172-a197-4462-93aa-e6638fe8d06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0c79be-282b-4165-8c96-6d400ed4e1b9', 'volume_name': 'volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be08c5d-9ca0-4a16-9f4a-4ec5264e9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be08c5d-9ca0-4a16-9f4a-4ec5264e9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa792f3d-713f-4cbe-9d40-3fa3b9fdd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Volume fc0c79be-282b-4165-8c96-6d400ed4e1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9', 'volume_size': 1} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-493838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0c79be-282b-4165-8c96-6d400ed4e1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8aa9fff436f4f87bd6b63212994dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:24Z,use_quota=True,user_id='49dda9d96c2743a4ac68a65d7ca122a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Creating volume fc0c79be-282b-4165-8c96-6d400ed4e1b9 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:47:24 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:24 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 1073741824 Jul 10 07:47:24 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Flow 'volume_create_manager' (2cf129e5-1609-4321-9365-d1b7c548345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2fa35e-62c3-4c40-909f-b05f225fb0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2fa35e-62c3-4c40-909f-b05f225fb0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2121401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daa453a-8026-465f-9949-b4483e38e93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32334aa4614648e3bff6038ca6b8e792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:25Z,use_quota=True,user_id='37d0968b1dfa43c88667062db4370808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0d67c1-1002-4010-a1d6-12739fec9aad),volume_type_id=5d0d67c1-1002-4010-a1d6-12739fec9aad)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db9e3d8-919d-430f-865d-bc35382ce6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db9e3d8-919d-430f-865d-bc35382ce6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34799047-fec7-4c72-88b6-810c2fa89acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34799047-fec7-4c72-88b6-810c2fa89acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daa453a-8026-465f-9949-b4483e38e93c', 'volume_name': 'volume-5daa453a-8026-465f-9949-b4483e38e93c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb9f57b-21a1-4187-b7d5-10a017b203af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb9f57b-21a1-4187-b7d5-10a017b203af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9fc33b-37bb-4d7f-af9b-70212f90458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Volume 5daa453a-8026-465f-9949-b4483e38e93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daa453a-8026-465f-9949-b4483e38e93c', 'volume_size': 1} Jul 10 07:47:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:25 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 1073741824" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:25 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 Jul 10 07:47:25 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:25 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2121401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daa453a-8026-465f-9949-b4483e38e93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32334aa4614648e3bff6038ca6b8e792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:47:25Z,use_quota=True,user_id='37d0968b1dfa43c88667062db4370808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0d67c1-1002-4010-a1d6-12739fec9aad),volume_type_id=5d0d67c1-1002-4010-a1d6-12739fec9aad)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Creating volume 5daa453a-8026-465f-9949-b4483e38e93c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:47:25 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:25 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c 1073741824 Jul 10 07:47:25 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa792f3d-713f-4cbe-9d40-3fa3b9fdd76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b032ae75-6bde-4d01-a0e4-5df81c791315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Volume volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 (fc0c79be-282b-4165-8c96-6d400ed4e1b9): created successfully Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b032ae75-6bde-4d01-a0e4-5df81c791315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Flow 'volume_create_manager' (4fbc1942-d5d3-4292-8600-150ef58fb655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-01ca00a4-350c-4f1c-8615-ec827cc6703e tempest-ServersNegativeTestJSON-1191495202 None] Created volume successfully. Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "cinder-fc0c79be-282b-4165-8c96-6d400ed4e1b9-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-fc0c79be-282b-4165-8c96-6d400ed4e1b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "cinder-quobyte-fc0c79be-282b-4165-8c96-6d400ed4e1b9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-quobyte-fc0c79be-282b-4165-8c96-6d400ed4e1b9" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[286635f5-9790-46b8-b84d-bfa6929fc2d3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:26 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c 1073741824" returned: 0 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:26 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 Jul 10 07:47:26 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c Jul 10 07:47:26 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:26 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:27 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9fc33b-37bb-4d7f-af9b-70212f90458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daa453a-8026-465f-9949-b4483e38e93c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af06241a-c89b-4338-b723-1bdbcec1c9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:47:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Volume volume-5daa453a-8026-465f-9949-b4483e38e93c (5daa453a-8026-465f-9949-b4483e38e93c): created successfully Jul 10 07:47:27 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af06241a-c89b-4338-b723-1bdbcec1c9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Flow 'volume_create_manager' (2cf129e5-1609-4321-9365-d1b7c548345e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9" returned: 0 in 0.851s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4b8c8961-d1de-4b4c-a512-d20ff8a8b39f tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Created volume successfully. Jul 10 07:47:27 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9 Jul 10 07:47:27 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:28 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fc0c79be-282b-4165-8c96-6d400ed4e1b9" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-quobyte-fc0c79be-282b-4165-8c96-6d400ed4e1b9" released by "delete_volume" :: held 1.560s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Created reservations ['851179a6-58cf-4c9d-8ada-000f30f7e8a1', '31767b97-eac5-466f-81c0-4e8475dc26d7', '906d6482-7c03-4e53-82ff-3fdea2606aba', '97e1587b-4e0f-433b-ab0f-b7634e31fbdb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:28 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:28 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:28 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:28 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "cinder-3aa8ba53-9caa-4090-946b-37e038a1c959-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-3aa8ba53-9caa-4090-946b-37e038a1c959-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "cinder-quobyte-3aa8ba53-9caa-4090-946b-37e038a1c959" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-quobyte-3aa8ba53-9caa-4090-946b-37e038a1c959" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e9b8b7-cf58-4c20-a2c7-352071a2649d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:47:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:29 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 Jul 10 07:47:29 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:29 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-764168a8-cf69-43f9-9952-a90648879c28 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Retype volume completed successfully. Jul 10 07:47:29 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Deleted volume successfully. Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6dd66ece-1b67-4787-a286-00d9bb5c5def tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-fc0c79be-282b-4165-8c96-6d400ed4e1b9-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "cinder-5daa453a-8026-465f-9949-b4483e38e93c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "cinder-5daa453a-8026-465f-9949-b4483e38e93c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "cinder-quobyte-5daa453a-8026-465f-9949-b4483e38e93c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "cinder-quobyte-5daa453a-8026-465f-9949-b4483e38e93c" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc229683-6235-43fe-a172-4176977f8e0f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:29 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:29 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959 Jul 10 07:47:29 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:29 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c Jul 10 07:47:29 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:30 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3aa8ba53-9caa-4090-946b-37e038a1c959" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-quobyte-3aa8ba53-9caa-4090-946b-37e038a1c959" released by "delete_volume" :: held 1.540s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:30 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:30 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c Jul 10 07:47:30 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Created reservations ['569e8765-497f-48c5-9f36-f6110495c513', '145e13e7-3873-4e2e-89d1-37f543d3fdfe', '84c1b3c9-20fa-49c1-bac7-e29a046e6134', '4f33c2f4-2852-45f9-8a0b-a0532df74fff'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:30 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:30 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-297e7076-19e0-470d-9524-92e2716f958e req-c6050577-a77a-4d2d-9127-6f58cd9f93f9 tempest-ServerActionsTestOtherA-1371437059 None] Terminate volume connection completed successfully. Jul 10 07:47:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-297e7076-19e0-470d-9524-92e2716f958e req-c6050577-a77a-4d2d-9127-6f58cd9f93f9 tempest-ServerActionsTestOtherA-1371437059 None] Deleting attachment 32804a2e-37d1-4da9-b597-5b6d2189c67d. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:47:31 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5daa453a-8026-465f-9949-b4483e38e93c" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "cinder-quobyte-5daa453a-8026-465f-9949-b4483e38e93c" released by "delete_volume" :: held 1.493s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:31 devstack cinder-volume[87192]: WARNING cinder.quota [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:47:31 devstack cinder-volume[87192]: WARNING cinder.quota [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Created reservations ['d893bcc7-70bd-4cfd-90ce-c97b61959c24', '8d14b079-3546-44a8-b90a-c00c685227e0', '73fd4da6-2a01-4b4d-a69e-019f0cd28386', 'ae42224a-8efc-4b4c-8ca1-a6d24c7b5e85'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:47:31 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.710s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Deleted volume successfully. Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25086c71-b2fe-4a36-8ef4-47dd72dc39d2 tempest-ServersNegativeTestJSON-1191495202 None] Lock "cinder-3aa8ba53-9caa-4090-946b-37e038a1c959-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:31 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:31 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:31 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Deleted volume successfully. Jul 10 07:47:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ec1220-ee5f-413a-94c5-bcf4abf98fa2 tempest-VolumeRetypeWithoutMigrationTest-1388849924 None] Lock "cinder-5daa453a-8026-465f-9949-b4483e38e93c-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:36 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:36 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:37 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:47:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:47:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:47:41 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=45,cinder:INSERT=13,cinder:SELECT=39,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:47:41 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=33,cinder:UPDATE=52,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "cinder-f418eb5a-be2b-4f1c-a146-831e41d6d24e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "cinder-f418eb5a-be2b-4f1c-a146-831e41d6d24e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "cinder-quobyte-f418eb5a-be2b-4f1c-a146-831e41d6d24e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "cinder-quobyte-f418eb5a-be2b-4f1c-a146-831e41d6d24e" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c01968-3ca1-47d8-916b-9f674f24f333]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:47:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:43 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e Jul 10 07:47:43 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:44 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:44 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e Jul 10 07:47:44 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:45 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f418eb5a-be2b-4f1c-a146-831e41d6d24e" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "cinder-quobyte-f418eb5a-be2b-4f1c-a146-831e41d6d24e" released by "delete_volume" :: held 1.801s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Created reservations ['5736aa53-7203-4cd6-a6c5-7ef647d44a8e', '5114a7e4-f96a-4c5c-9c24-23b4f348fbae', 'e9e7af8b-08f4-4198-b9b3-04e7ae7c1261', '657e9a33-45a1-48c9-9854-1639e32f4869'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:47:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:47:45 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:47:45 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:47:46 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Jul 10 07:47:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.769s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:47:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:47:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Deleted volume successfully. Jul 10 07:47:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e62c2b58-27b4-409a-9108-0e45e9b87ad7 tempest-ServerActionsTestOtherA-1371437059 None] Lock "cinder-f418eb5a-be2b-4f1c-a146-831e41d6d24e-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:47:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-83fd1253-5514-4a65-a527-27b127c5bc2d req-09ec9685-68bf-4a59-a8bc-befe643ecb70 tempest-AttachVolumeNegativeTest-1771272357 None] Terminate volume connection completed successfully. Jul 10 07:47:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-83fd1253-5514-4a65-a527-27b127c5bc2d req-09ec9685-68bf-4a59-a8bc-befe643ecb70 tempest-AttachVolumeNegativeTest-1771272357 None] Deleting attachment 49485d56-ac56-4135-8c68-f02bd1f60fe2. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:48:02 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:48:02 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Flow 'volume_create_manager' (f161d77d-f5ff-447e-9d4d-c844d6589cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d04a9-9984-48c5-86b6-e1be29257c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d04a9-9984-48c5-86b6-e1be29257c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1426884341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29aba09-5bbb-43c2-83d3-7492c5677113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e68149cec34fa88cf529a40db18c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:13Z,use_quota=True,user_id='47b8a643468a4d07853dda0a99d9e857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bef1a1c-1503-401d-b5d5-c53ba184c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bef1a1c-1503-401d-b5d5-c53ba184c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb91e0d-e96a-4cdd-97b8-46c5ec6fc8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb91e0d-e96a-4cdd-97b8-46c5ec6fc8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29aba09-5bbb-43c2-83d3-7492c5677113', 'volume_name': 'volume-d29aba09-5bbb-43c2-83d3-7492c5677113', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e468f0-dc77-4842-b99d-a19c37c4d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e468f0-dc77-4842-b99d-a19c37c4d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ec9fba-a2ce-44c1-ba38-6752c77c327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Volume d29aba09-5bbb-43c2-83d3-7492c5677113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29aba09-5bbb-43c2-83d3-7492c5677113', 'volume_size': 1} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1426884341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29aba09-5bbb-43c2-83d3-7492c5677113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e68149cec34fa88cf529a40db18c3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:13Z,use_quota=True,user_id='47b8a643468a4d07853dda0a99d9e857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Creating volume d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:12 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:12 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 1073741824 Jul 10 07:48:12 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:13 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 1073741824" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:13 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 Jul 10 07:48:13 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:14 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ec9fba-a2ce-44c1-ba38-6752c77c327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29aba09-5bbb-43c2-83d3-7492c5677113', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840a3437-76c3-4479-a9f7-fda0d6828827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Volume volume-d29aba09-5bbb-43c2-83d3-7492c5677113 (d29aba09-5bbb-43c2-83d3-7492c5677113): created successfully Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840a3437-76c3-4479-a9f7-fda0d6828827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Flow 'volume_create_manager' (f161d77d-f5ff-447e-9d4d-c844d6589cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ec421d0c-2b04-47ef-a295-947dbd44349b req-0ff5ce48-8744-4208-a2b5-84c1da4f76d6 tempest-VolumesSnapshotsTestJSON-1632521825 None] Created volume successfully. Jul 10 07:48:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Creating offline snapshot c99dd220-2a6c-4576-836e-d5b36eda4a1b of volume d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:48:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c9f912-7907-402a-bfe1-56107e4355ce]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:15 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 Jul 10 07:48:15 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:16 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:16 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b 1G Jul 10 07:48:16 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:17 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b 1G" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29aba09-5bbb-43c2-83d3-7492c5677113 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:17 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29aba09-5bbb-43c2-83d3-7492c5677113 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b Jul 10 07:48:17 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:18 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29aba09-5bbb-43c2-83d3-7492c5677113 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b" returned: 0 in 0.898s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b is being set with open permissions: ugo+rw Jul 10 07:48:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:18 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b Jul 10 07:48:18 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:19 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:19 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info Jul 10 07:48:19 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:19 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info" returned: 0 in 0.878s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:19 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info is being set with open permissions: ugo+rw Jul 10 07:48:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:20 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info Jul 10 07:48:20 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:20 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.info" returned: 0 in 0.887s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.410s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-31fc3e85-107e-424d-a2cd-85e8da6b9f3d req-5c533a96-9cab-499c-b8b3-da5b2b9c24d3 tempest-VolumesSnapshotsTestJSON-1632521825 None] Create snapshot completed successfully Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "cinder-c99dd220-2a6c-4576-836e-d5b36eda4a1b-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-c99dd220-2a6c-4576-836e-d5b36eda4a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "cinder-quobyte-c99dd220-2a6c-4576-836e-d5b36eda4a1b" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-c99dd220-2a6c-4576-836e-d5b36eda4a1b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Deleting offline snapshot c99dd220-2a6c-4576-836e-d5b36eda4a1b of volume d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] snapshot_file for this snap is: volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b4f270-b4cb-46b7-ae4e-4238b9b0a0d1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:21 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b Jul 10 07:48:21 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:22 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b" returned: 0 in 1.084s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29aba09-5bbb-43c2-83d3-7492c5677113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:48:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc79de1-a8fe-492b-a178-4bfbc99fe114]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:22 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 Jul 10 07:48:22 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:24 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113" returned: 0 in 1.417s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:24 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b Jul 10 07:48:24 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:25 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b" returned: 0 in 1.099s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:25 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b Jul 10 07:48:25 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:27 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113.c99dd220-2a6c-4576-836e-d5b36eda4a1b" returned: 0 in 2.455s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-c99dd220-2a6c-4576-836e-d5b36eda4a1b" released by "_delete_snapshot" :: held 6.363s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" released by "delete_snapshot" :: held 6.416s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:27 devstack cinder-volume[87192]: WARNING cinder.quota [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.quota [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Created reservations ['7c75aa48-7ebc-4b98-8b7f-e9eb83c0b701', 'c7a22c7f-d636-4d2d-a52c-8e77d26aeb9f', 'cbc09364-267e-4492-ba0d-48bc96a98873', '22dcd1d5-160a-4610-96c1-55b2ced94c6c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:48:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Delete snapshot completed successfully. Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-df9df099-d9ae-469e-9e51-78958266014a req-f5f097db-2e36-423f-aca6-0103670f36cc tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-c99dd220-2a6c-4576-836e-d5b36eda4a1b-delete_snapshot" released by "delete_snapshot" :: held 6.779s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "cinder-d29aba09-5bbb-43c2-83d3-7492c5677113-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-d29aba09-5bbb-43c2-83d3-7492c5677113-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27495a-b622-418e-8bdb-99150fec2aa8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:29 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 Jul 10 07:48:29 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (27b99102-50b3-4775-8d0e-e8a6e385ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5fa7c7-08b2-45cb-951f-375a9e62369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5fa7c7-08b2-45cb-951f-375a9e62369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1547286462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd2313c-645b-4c3c-94a8-4eca405f68f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:29Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30ab0ff-5ead-455f-b701-628dfe39ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30ab0ff-5ead-455f-b701-628dfe39ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712998ee-3aa2-416a-91bb-dd5009d1f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712998ee-3aa2-416a-91bb-dd5009d1f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd2313c-645b-4c3c-94a8-4eca405f68f2', 'volume_name': 'volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6049f9c8-4929-4c3e-b505-d243e67c3ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6049f9c8-4929-4c3e-b505-d243e67c3ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af60e9d1-7478-4018-bfa8-edcb7c4003ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Volume cbd2313c-645b-4c3c-94a8-4eca405f68f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2', 'volume_size': 1} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1547286462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd2313c-645b-4c3c-94a8-4eca405f68f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:29Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Creating volume cbd2313c-645b-4c3c-94a8-4eca405f68f2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:29 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 1073741824 Jul 10 07:48:29 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:31 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113" returned: 0 in 2.338s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:31 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113 Jul 10 07:48:31 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:31 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 1073741824" returned: 0 in 1.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:31 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 Jul 10 07:48:31 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:32 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d29aba09-5bbb-43c2-83d3-7492c5677113" returned: 0 in 1.249s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-quobyte-d29aba09-5bbb-43c2-83d3-7492c5677113" released by "delete_volume" :: held 3.716s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG cinder.quota [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Created reservations ['f57f5c5a-fb69-4e24-99b5-3e2ca4084418', '22348518-0f5f-4f82-83bd-66b483e88732', 'c5d4bb6c-b3dd-426a-8f94-ade37a59dd4a', 'aba0e7ac-ea09-4efe-9e13-b0dd4b0373f2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:32 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:48:32 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:33 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2" returned: 0 in 1.302s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] <== create_volume: return (3325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.333s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af60e9d1-7478-4018-bfa8-edcb7c4003ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373c5eec-190c-499d-80e1-63bc252861e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Volume volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 (cbd2313c-645b-4c3c-94a8-4eca405f68f2): created successfully Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373c5eec-190c-499d-80e1-63bc252861e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (27b99102-50b3-4775-8d0e-e8a6e385ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6b85fee2-83b9-4f0f-bb2e-51fc7038eb64 tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:48:33 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.185s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.manager [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:48:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Deleted volume successfully. Jul 10 07:48:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-4829fc61-2c55-4938-b1a4-c5163a572e9b req-473a28c0-67a9-41aa-81e4-3af954504c4e tempest-VolumesSnapshotsTestJSON-1632521825 None] Lock "cinder-d29aba09-5bbb-43c2-83d3-7492c5677113-delete_volume" released by "delete_volume" :: held 5.336s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5efb77e-a197-4b87-ab33-4f6ed88f928b tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5efb77e-a197-4b87-ab33-4f6ed88f928b tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2" acquired by "attach_volume" :: waited 0.061s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f5efb77e-a197-4b87-ab33-4f6ed88f928b tempest-VolumesActionsTest-936243135 None] Attaching volume cbd2313c-645b-4c3c-94a8-4eca405f68f2 to instance 5fbc2d27-6791-43c8-9258-7909597f895e at mountpoint /dev/vdb on host None. Jul 10 07:48:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f5efb77e-a197-4b87-ab33-4f6ed88f928b tempest-VolumesActionsTest-936243135 None] Attach volume completed successfully. Jul 10 07:48:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5efb77e-a197-4b87-ab33-4f6ed88f928b tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2" released by "attach_volume" :: held 0.257s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Terminate volume connection completed successfully. Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:36 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:48:36 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Detaching volume cbd2313c-645b-4c3c-94a8-4eca405f68f2 from instance 5fbc2d27-6791-43c8-9258-7909597f895e. Jul 10 07:48:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Detach volume completed successfully. Jul 10 07:48:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67282028-1f72-4867-99dc-c72088485510 tempest-VolumesActionsTest-445048438 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4ee42de8-9a58-4733-abcb-1ab54bf1decd tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4ee42de8-9a58-4733-abcb-1ab54bf1decd tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" acquired by "detach_volume" :: waited 0.100s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4ee42de8-9a58-4733-abcb-1ab54bf1decd tempest-VolumesActionsTest-936243135 None] Volume detach called, but volume not attached. Jul 10 07:48:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4ee42de8-9a58-4733-abcb-1ab54bf1decd tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:37 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.591s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-quobyte-cbd2313c-645b-4c3c-94a8-4eca405f68f2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "cinder-quobyte-cbd2313c-645b-4c3c-94a8-4eca405f68f2" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8394091d-71bb-4cfb-bfc6-8be9677b87d9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:38 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 Jul 10 07:48:38 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:40 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2" returned: 0 in 1.341s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:40 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2 Jul 10 07:48:40 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:41 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbd2313c-645b-4c3c-94a8-4eca405f68f2" returned: 0 in 0.964s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "cinder-quobyte-cbd2313c-645b-4c3c-94a8-4eca405f68f2" released by "delete_volume" :: held 2.377s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Created reservations ['de0fff75-4a3f-4453-b9ee-9857f787ec88', 'd26ebb53-f1e0-41a9-b6cd-3e202d9971ae', '5fe251bc-b4bd-4a6c-bdaa-aac1e07604a2', 'f913a3cc-33e7-4006-a9ef-86f95b108e5f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:41 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:48:41 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:42 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.261s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:48:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Deleted volume successfully. Jul 10 07:48:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-353006fa-26fd-4fa4-a5ae-c1db90c82eb3 tempest-VolumesActionsTest-936243135 None] Lock "cinder-cbd2313c-645b-4c3c-94a8-4eca405f68f2-delete_volume" released by "delete_volume" :: held 4.058s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (5c668b87-ca29-407a-a4d5-375f68ae05d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7104c-504a-4c45-b214-90fc32ac9770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7104c-504a-4c45-b214-90fc32ac9770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1492730660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ce4d1a-d41d-452e-92f3-a04cc4e54d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:50Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbcd188-b25a-417a-8d65-4dbecec2dbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbcd188-b25a-417a-8d65-4dbecec2dbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289120c-274c-4ac5-97ae-1eef41436114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289120c-274c-4ac5-97ae-1eef41436114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ce4d1a-d41d-452e-92f3-a04cc4e54d43', 'volume_name': 'volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d7464-8085-4bad-a7a9-13e666c8c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d7464-8085-4bad-a7a9-13e666c8c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c8ec0-478f-42bf-a398-5ceaf390c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Volume 65ce4d1a-d41d-452e-92f3-a04cc4e54d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43', 'volume_size': 1} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1492730660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ce4d1a-d41d-452e-92f3-a04cc4e54d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:50Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Creating volume 65ce4d1a-d41d-452e-92f3-a04cc4e54d43 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:50 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 1073741824 Jul 10 07:48:50 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Flow 'volume_create_manager' (fb12b7c5-0c87-46e1-9b52-da28911bef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922253f-c0d0-4583-b275-dfa1f8eacaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922253f-c0d0-4583-b275-dfa1f8eacaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1408485272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cbbfcc-004e-4144-a654-c6feaab308ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4432f4a8a3434191c815cafeea1bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:51Z,use_quota=True,user_id='d9fa66fe7e294a2e84a9b3b35bdf7f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1a11ee-942e-4437-8032-3ecb504d043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1a11ee-942e-4437-8032-3ecb504d043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ac3398-cb4f-42c2-a4f5-81446b551cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ac3398-cb4f-42c2-a4f5-81446b551cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80cbbfcc-004e-4144-a654-c6feaab308ff', 'volume_name': 'volume-80cbbfcc-004e-4144-a654-c6feaab308ff', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5c4917-17b5-4f96-b134-8de2a9985d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5c4917-17b5-4f96-b134-8de2a9985d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe34dbc-9a74-4b75-9413-b0bb4046f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Volume 80cbbfcc-004e-4144-a654-c6feaab308ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80cbbfcc-004e-4144-a654-c6feaab308ff', 'volume_size': 1} Jul 10 07:48:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:51 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 1073741824" returned: 0 in 0.945s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:51 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 Jul 10 07:48:51 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:52 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1408485272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cbbfcc-004e-4144-a654-c6feaab308ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4432f4a8a3434191c815cafeea1bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:51Z,use_quota=True,user_id='d9fa66fe7e294a2e84a9b3b35bdf7f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Creating volume 80cbbfcc-004e-4144-a654-c6feaab308ff {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:52 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c8ec0-478f-42bf-a398-5ceaf390c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:52 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff 1073741824 Jul 10 07:48:52 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7191a1ae-7f31-4ced-bad1-9f0bd1d0c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Volume volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 (65ce4d1a-d41d-452e-92f3-a04cc4e54d43): created successfully Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7191a1ae-7f31-4ced-bad1-9f0bd1d0c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (5c668b87-ca29-407a-a4d5-375f68ae05d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-82675836-5774-49ff-ac72-74b6fb77212d tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-65ce4d1a-d41d-452e-92f3-a04cc4e54d43-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "cinder-65ce4d1a-d41d-452e-92f3-a04cc4e54d43-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-quobyte-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157c2b4-ba17-4a52-91ba-848b6d9df618]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:53 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 Jul 10 07:48:53 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:53 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff 1073741824" returned: 0 in 1.233s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:53 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff Jul 10 07:48:53 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:53 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:53 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43 Jul 10 07:48:53 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:54 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe34dbc-9a74-4b75-9413-b0bb4046f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80cbbfcc-004e-4144-a654-c6feaab308ff', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31694498-139e-437e-a47f-0bf6c92ce9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Volume volume-80cbbfcc-004e-4144-a654-c6feaab308ff (80cbbfcc-004e-4144-a654-c6feaab308ff): created successfully Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31694498-139e-437e-a47f-0bf6c92ce9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Flow 'volume_create_manager' (fb12b7c5-0c87-46e1-9b52-da28911bef87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c1542ec9-7a5f-4ed0-bea3-05d1eb206ecf tempest-AttachVolumeShelveTestJSON-567619578 None] Created volume successfully. Jul 10 07:48:54 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-65ce4d1a-d41d-452e-92f3-a04cc4e54d43" released by "delete_volume" :: held 1.704s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Created reservations ['c388f262-aef1-484f-b4bf-9170a5b55c23', 'd84ee279-e642-4615-b811-bebe6d4c5032', '59e13c71-d550-4565-b68d-72f1642889b8', '6df6728e-314d-41ac-bea9-3d579ef2d3d5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:54 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:48:54 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:55 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:48:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Deleted volume successfully. Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-afcdd607-66b4-4cdd-945f-03575af46e1f tempest-VolumesActionsTest-445048438 None] Lock "cinder-65ce4d1a-d41d-452e-92f3-a04cc4e54d43-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (6309c07c-b8f3-4db5-ae45-8f0cf6532187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ae48a-e880-4476-a371-b46fbc6d1cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ae48a-e880-4476-a371-b46fbc6d1cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1589505677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7bd9a3-8166-4ede-ae4f-1c0c5900e038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:56Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400a2adf-5915-4048-aea8-eae542e967ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400a2adf-5915-4048-aea8-eae542e967ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b5b824-fde2-4783-be7a-65286f68798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b5b824-fde2-4783-be7a-65286f68798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7bd9a3-8166-4ede-ae4f-1c0c5900e038', 'volume_name': 'volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794793f6-da69-4445-8339-e7c06e1595ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794793f6-da69-4445-8339-e7c06e1595ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8275f29d-69a1-4c47-b4de-c415fa714e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Volume fb7bd9a3-8166-4ede-ae4f-1c0c5900e038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038', 'volume_size': 1} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1589505677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7bd9a3-8166-4ede-ae4f-1c0c5900e038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:56Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Creating volume fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:56 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 1073741824 Jul 10 07:48:56 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (32138d14-aa00-4d76-a6f1-90e6349d397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f108f2-0af0-40ab-b410-b5699893a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f108f2-0af0-40ab-b410-b5699893a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1628745854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138998e6-ceee-4c67-95f6-4b0efac06602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:56Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1832a148-d338-44e8-9d44-0f1246dbadaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1832a148-d338-44e8-9d44-0f1246dbadaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff86b377-c587-4dd7-bb08-ea50ef70c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff86b377-c587-4dd7-bb08-ea50ef70c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138998e6-ceee-4c67-95f6-4b0efac06602', 'volume_name': 'volume-138998e6-ceee-4c67-95f6-4b0efac06602', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae4665d-c4f6-46a3-b0ba-927a05449ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae4665d-c4f6-46a3-b0ba-927a05449ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ef566-918c-4091-9084-a9d214efd1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Volume 138998e6-ceee-4c67-95f6-4b0efac06602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138998e6-ceee-4c67-95f6-4b0efac06602', 'volume_size': 1} Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:56 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 1073741824" returned: 0 in 1.014s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:57 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 Jul 10 07:48:57 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:57 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1628745854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138998e6-ceee-4c67-95f6-4b0efac06602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:48:56Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Creating volume 138998e6-ceee-4c67-95f6-4b0efac06602 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:48:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:57 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 1073741824 Jul 10 07:48:57 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8275f29d-69a1-4c47-b4de-c415fa714e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a029e352-ea18-4aa9-a29f-5a05fc997604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Volume volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 (fb7bd9a3-8166-4ede-ae4f-1c0c5900e038): created successfully Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a029e352-ea18-4aa9-a29f-5a05fc997604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (6309c07c-b8f3-4db5-ae45-8f0cf6532187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-38b20ed9-fbed-49c2-9789-27d7803e9ceb tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "cinder-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-quobyte-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab0b99d-02fb-4d8a-8f23-14aae9db7d61]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:58 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 Jul 10 07:48:58 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:58 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 1073741824" returned: 0 in 1.071s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:58 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 Jul 10 07:48:58 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:59 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:48:59 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038 Jul 10 07:48:59 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:48:59 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ef566-918c-4091-9084-a9d214efd1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138998e6-ceee-4c67-95f6-4b0efac06602', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51e985-affd-4b14-b54f-3c69d21fb7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:48:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Volume volume-138998e6-ceee-4c67-95f6-4b0efac06602 (138998e6-ceee-4c67-95f6-4b0efac06602): created successfully Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51e985-affd-4b14-b54f-3c69d21fb7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (32138d14-aa00-4d76-a6f1-90e6349d397e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:48:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d47692b2-9c93-47ba-bdff-7ba41d548725 tempest-AttachVolumeNegativeTest-1771272357 None] Created volume successfully. Jul 10 07:48:59 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038" released by "delete_volume" :: held 1.704s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:48:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Created reservations ['d4c201f6-4dbd-4a46-88d5-74ed6ca84968', '1ff2b84f-b22b-4e22-b05a-2430031bcdc9', '5e0be30d-ad84-4ae3-aae0-a7c7fc2c20c3', '5921cd1a-5299-4659-85b5-894a26140562'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:00 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:00 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:00 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.895s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Deleted volume successfully. Jul 10 07:49:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb7837be-9fff-43b6-9fb0-73fb4179d944 tempest-VolumesActionsTest-445048438 None] Lock "cinder-fb7bd9a3-8166-4ede-ae4f-1c0c5900e038-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (9dd08a0f-f789-4cbd-9a52-8b54e54cbeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2d29bf-784d-4af9-8ab3-6fde02713cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2d29bf-784d-4af9-8ab3-6fde02713cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1940143691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46feec2-abc8-4d3e-80c3-ba4640d5a2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:01Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dcda03-b295-444d-bec6-cddfa0c0763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dcda03-b295-444d-bec6-cddfa0c0763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812f3b51-f45f-47c9-8932-78c8d1113c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812f3b51-f45f-47c9-8932-78c8d1113c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46feec2-abc8-4d3e-80c3-ba4640d5a2c6', 'volume_name': 'volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05a7345-4a0d-4d1e-ac71-7310fa7439be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05a7345-4a0d-4d1e-ac71-7310fa7439be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec76e3f-d6ac-486a-829a-9a7b3f5087de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Volume e46feec2-abc8-4d3e-80c3-ba4640d5a2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6', 'volume_size': 1} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1940143691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46feec2-abc8-4d3e-80c3-ba4640d5a2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:01Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Creating volume e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:01 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:01 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 1073741824 Jul 10 07:49:01 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:02 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 1073741824" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:02 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 Jul 10 07:49:02 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:03 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec76e3f-d6ac-486a-829a-9a7b3f5087de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feaa510-430e-4ae1-8d8e-2905ec208d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Volume volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 (e46feec2-abc8-4d3e-80c3-ba4640d5a2c6): created successfully Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feaa510-430e-4ae1-8d8e-2905ec208d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (9dd08a0f-f789-4cbd-9a52-8b54e54cbeb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3a73fccd-4759-4e10-ac52-1c71e14748d1 tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "cinder-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-quobyte-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c9ea4-5c75-4bc6-907a-ac84c5f407b4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e12af-c89a-4ac9-bc0e-1072d5b58e11]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:03 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 Jul 10 07:49:03 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:04 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 Jul 10 07:49:04 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:04 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" returned: 0 in 1.117s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:05 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6 Jul 10 07:49:05 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:05 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Flow 'volume_create_manager' (1ade7910-157f-445f-9de0-b8742eae4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46084f3-cfc2-4eaa-a6e2-2a56a9cc2f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602" returned: 0 in 1.136s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46084f3-cfc2-4eaa-a6e2-2a56a9cc2f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-374128423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd6fa9-70cb-4589-b6f1-980cbf184de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3167f8e15dd740fcb9322e6601657adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:05Z,use_quota=True,user_id='03fdd8e7de34477292a005fffc3e166a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3542742d-a8d8-4d74-aa55-612add4ab721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3542742d-a8d8-4d74-aa55-612add4ab721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c4160-4f56-491f-aacb-88db83a6a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c4160-4f56-491f-aacb-88db83a6a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbd6fa9-70cb-4589-b6f1-980cbf184de1', 'volume_name': 'volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d3bac3-6cf3-4501-bb34-0062ea44af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d3bac3-6cf3-4501-bb34-0062ea44af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11401752-0907-4b4d-a040-29c50661239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Volume bfbd6fa9-70cb-4589-b6f1-980cbf184de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1', 'volume_size': 1} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-374128423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd6fa9-70cb-4589-b6f1-980cbf184de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3167f8e15dd740fcb9322e6601657adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:05Z,use_quota=True,user_id='03fdd8e7de34477292a005fffc3e166a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Creating volume bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:05 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:05 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 1073741824 Jul 10 07:49:05 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-138998e6-ceee-4c67-95f6-4b0efac06602', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69ce6b0d-38a6-441a-b953-70a8f404df26', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:49:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-c80b781c-7ed1-4586-a064-273823835bfa req-c8b2ac23-8525-49ae-9247-8015800c7890 tempest-AttachVolumeNegativeTest-1771272357 None] attachment_update completed successfully. Jul 10 07:49:05 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6" released by "delete_volume" :: held 1.917s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Created reservations ['5f780c9a-8235-438d-8fa8-e0f99c27c4a3', '1ef7e964-3db4-4337-a199-221625d55143', 'f796f5d8-047f-4abb-9b50-babc7887d707', '798e8ecb-b881-4467-927d-30dc4dffb9c1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:05 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:05 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:06 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 1073741824" returned: 0 in 0.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:06 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 Jul 10 07:49:06 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:06 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Deleted volume successfully. Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c2d2e52-aa02-4a7f-903a-8bfc87d24ad1 tempest-VolumesActionsTest-445048438 None] Lock "cinder-e46feec2-abc8-4d3e-80c3-ba4640d5a2c6-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (f273e1d5-4774-41bf-b97a-fba9d3e82a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298f008-5d95-4ae5-bdf0-9c6b94b2eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8298f008-5d95-4ae5-bdf0-9c6b94b2eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1618600858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ca5851-e3e7-42a7-b9ff-a0e785851dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:07Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7405708b-fc2c-468d-98fe-ce1e3a9866b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7405708b-fc2c-468d-98fe-ce1e3a9866b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc51068-349f-406c-a915-6da1c429c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc51068-349f-406c-a915-6da1c429c694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ca5851-e3e7-42a7-b9ff-a0e785851dc7', 'volume_name': 'volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d74e1d1-7c56-4ba2-97ff-bc8968a2dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d74e1d1-7c56-4ba2-97ff-bc8968a2dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d00744-4d56-438b-a966-b226d761315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Volume 68ca5851-e3e7-42a7-b9ff-a0e785851dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7', 'volume_size': 1} Jul 10 07:49:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:07 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" returned: 0 in 0.892s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1618600858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ca5851-e3e7-42a7-b9ff-a0e785851dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:07Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Creating volume 68ca5851-e3e7-42a7-b9ff-a0e785851dc7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11401752-0907-4b4d-a040-29c50661239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:07 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 1073741824 Jul 10 07:49:07 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d4b49b-840e-45b8-b5f9-50b19be75e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Volume volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 (bfbd6fa9-70cb-4589-b6f1-980cbf184de1): created successfully Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d4b49b-840e-45b8-b5f9-50b19be75e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Flow 'volume_create_manager' (1ade7910-157f-445f-9de0-b8742eae4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bc21be3c-ca16-462e-b46a-487bdd214c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Created volume successfully. Jul 10 07:49:07 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 1073741824" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:07 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 Jul 10 07:49:07 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:08 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.268s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Creating offline snapshot 899e1a26-388f-4685-8b47-14df140d6c6f of volume bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d00744-4d56-438b-a966-b226d761315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26df0a93-ab10-4d33-a8ea-3f4859578731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ff8b3d-f33d-4fe2-8a40-43d480a5f1bf]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Volume volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 (68ca5851-e3e7-42a7-b9ff-a0e785851dc7): created successfully Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26df0a93-ab10-4d33-a8ea-3f4859578731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (f273e1d5-4774-41bf-b97a-fba9d3e82a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6ce4d360-4843-4f4f-9229-dc6b024e8563 tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:49:08 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 Jul 10 07:49:08 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:09 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:09 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f 1G Jul 10 07:49:09 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-68ca5851-e3e7-42a7-b9ff-a0e785851dc7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "cinder-68ca5851-e3e7-42a7-b9ff-a0e785851dc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Acquiring lock "cinder-quobyte-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[159c197c-cc60-46e8-ab1d-34fe9d615505]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:10 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 Jul 10 07:49:10 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:10 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f 1G" returned: 0 in 1.015s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:10 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f Jul 10 07:49:10 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:11 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" returned: 0 in 1.034s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:11 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7 Jul 10 07:49:11 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-2a654c76-ca5e-4052-ba0b-bd66fe787975 req-8dc0cdf0-e0f2-4e29-be1b-b1b149c7ec13 tempest-AttachVolumeShelveTestJSON-567619578 None] No connector for attachment f4577de8-ddb0-4a53-8651-0ff83e4c0648; skipping storage backend terminate_connection call. {{(pid=87192) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-2a654c76-ca5e-4052-ba0b-bd66fe787975 req-8dc0cdf0-e0f2-4e29-be1b-b1b149c7ec13 tempest-AttachVolumeShelveTestJSON-567619578 None] Deleting attachment f4577de8-ddb0-4a53-8651-0ff83e4c0648. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:49:11 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f is being set with open permissions: ugo+rw Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:11 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f Jul 10 07:49:11 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:11 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "cinder-quobyte-68ca5851-e3e7-42a7-b9ff-a0e785851dc7" released by "delete_volume" :: held 1.894s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Created reservations ['b20baa22-8148-4789-8cb9-abd7221b5fc6', 'b206fd27-0ae5-43b7-b278-b00d870d233e', 'e3f389c0-021d-4838-a15c-45661fb4cdcc', '304297e5-6c5a-48e0-a3f2-ca692c41c666'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:12 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:12 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:12 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:12 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info Jul 10 07:49:12 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-cfd82cbb-6576-4edd-b884-5d8c695a20b5 req-731d6139-0930-45b5-9255-257fc41f2cb1 tempest-AttachVolumeNegativeTest-1771272357 None] Terminate volume connection completed successfully. Jul 10 07:49:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-cfd82cbb-6576-4edd-b884-5d8c695a20b5 req-731d6139-0930-45b5-9255-257fc41f2cb1 tempest-AttachVolumeNegativeTest-1771272357 None] Deleting attachment 69ce6b0d-38a6-441a-b953-70a8f404df26. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=70,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=82,cinder:UPDATE=91,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (0a609e65-1f10-4d0f-8bf2-ed72867bbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:13 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6a716-6dce-4e59-8515-289992ab6fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:13 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.074s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info" returned: 0 in 1.002s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info is being set with open permissions: ugo+rw Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Deleted volume successfully. Jul 10 07:49:13 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6a716-6dce-4e59-8515-289992ab6fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887851410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594f069a-1024-4f49-9a2d-e392c658c8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:13Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:13 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9bc81b-e55f-430f-b7fb-00e0ef7988a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9bc81b-e55f-430f-b7fb-00e0ef7988a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0679d2-a4c6-41dd-9854-e6fabd65502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0679d2-a4c6-41dd-9854-e6fabd65502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594f069a-1024-4f49-9a2d-e392c658c8fd', 'volume_name': 'volume-594f069a-1024-4f49-9a2d-e392c658c8fd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a591e5d-4b19-46a7-aaac-fbcca7ab1b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a591e5d-4b19-46a7-aaac-fbcca7ab1b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68057d14-7117-4df6-8423-fd34ced7c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Volume 594f069a-1024-4f49-9a2d-e392c658c8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594f069a-1024-4f49-9a2d-e392c658c8fd', 'volume_size': 1} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-88f98e29-95c4-4856-8de3-69b98061950f tempest-VolumesActionsTest-445048438 None] Lock "cinder-68ca5851-e3e7-42a7-b9ff-a0e785851dc7-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:13 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.info" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887851410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594f069a-1024-4f49-9a2d-e392c658c8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2dab9ed1ab4281a700190081b20fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:13Z,use_quota=True,user_id='67a1d60a3f4d4f8886e0116374f14f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Creating volume 594f069a-1024-4f49-9a2d-e392c658c8fd {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:13 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd 1073741824 Jul 10 07:49:13 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0e2259ca-dbf0-4b26-ba49-6ab43323a155 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Create snapshot completed successfully Jul 10 07:49:14 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd 1073741824" returned: 0 in 0.900s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:14 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd Jul 10 07:49:14 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "cinder-899e1a26-388f-4685-8b47-14df140d6c6f-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-899e1a26-388f-4685-8b47-14df140d6c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "cinder-quobyte-899e1a26-388f-4685-8b47-14df140d6c6f" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-899e1a26-388f-4685-8b47-14df140d6c6f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Deleting offline snapshot 899e1a26-388f-4685-8b47-14df140d6c6f of volume bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] snapshot_file for this snap is: volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c54bdd1-213f-4e40-bbe9-b5310769ab30]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:15 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68057d14-7117-4df6-8423-fd34ced7c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594f069a-1024-4f49-9a2d-e392c658c8fd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb7c0f7-dc29-4b6c-bc22-8c53e15f81d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Volume volume-594f069a-1024-4f49-9a2d-e392c658c8fd (594f069a-1024-4f49-9a2d-e392c658c8fd): created successfully Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb7c0f7-dc29-4b6c-bc22-8c53e15f81d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Flow 'volume_create_manager' (0a609e65-1f10-4d0f-8bf2-ed72867bbbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2977d6f1-bebd-4a19-b08c-c6963c98f4fe tempest-VolumesActionsTest-936243135 None] Created volume successfully. Jul 10 07:49:15 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f Jul 10 07:49:15 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:16 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f" returned: 0 in 0.985s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:49:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd5c11-1364-4dd3-ab7c-471d26b699c5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:16 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 Jul 10 07:49:16 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-594f069a-1024-4f49-9a2d-e392c658c8fd-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "cinder-594f069a-1024-4f49-9a2d-e392c658c8fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Acquiring lock "cinder-quobyte-594f069a-1024-4f49-9a2d-e392c658c8fd" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "cinder-quobyte-594f069a-1024-4f49-9a2d-e392c658c8fd" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e917f-dfa7-4007-ba99-6cdde19b137b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:17 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd Jul 10 07:49:17 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:17 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" returned: 0 in 0.953s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:17 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f Jul 10 07:49:17 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:18 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd" returned: 0 in 1.023s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:18 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd Jul 10 07:49:18 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:18 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:18 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f Jul 10 07:49:18 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:18 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-594f069a-1024-4f49-9a2d-e392c658c8fd" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "cinder-quobyte-594f069a-1024-4f49-9a2d-e392c658c8fd" released by "delete_volume" :: held 1.746s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Created reservations ['6c06ee6a-3829-42ef-9692-a02ea3a10f65', '82f1ca2b-8c54-4092-ab09-2a02e99322cb', '807ea538-9528-4ec2-94c1-ffc69e258e2b', '9fd70e7f-1d41-4c9f-8a90-19197e9fdb29'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:19 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:19 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:19 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1.899e1a26-388f-4685-8b47-14df140d6c6f" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-899e1a26-388f-4685-8b47-14df140d6c6f" released by "_delete_snapshot" :: held 3.692s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" released by "delete_snapshot" :: held 3.722s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Created reservations ['3ac7ffeb-c941-417f-bf12-c97508a44c1b', 'e7133ce3-db81-4142-ab0a-136136828d18', 'b8dc94d3-25d8-45dc-bb01-fd76d1b1667f', '74680938-933c-4df0-ab58-a28ccf7115e9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Delete snapshot completed successfully. Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0b659fae-e7cb-4014-a2ee-34814d662394 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-899e1a26-388f-4685-8b47-14df140d6c6f-delete_snapshot" released by "delete_snapshot" :: held 3.914s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "cinder-bfbd6fa9-70cb-4589-b6f1-980cbf184de1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-bfbd6fa9-70cb-4589-b6f1-980cbf184de1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:19 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:19 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Deleted volume successfully. Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09cc68d3-aba6-4368-96cd-8e1c101b638d tempest-VolumesActionsTest-936243135 None] Lock "cinder-594f069a-1024-4f49-9a2d-e392c658c8fd-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231e684-d263-47ab-84a7-dba50f931448]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:20 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 Jul 10 07:49:20 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:20 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" returned: 0 in 0.924s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:21 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1 Jul 10 07:49:21 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:21 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-quobyte-bfbd6fa9-70cb-4589-b6f1-980cbf184de1" released by "delete_volume" :: held 1.713s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Created reservations ['9687b2a5-97d8-4684-a1b4-30e3d37340c3', '68609800-35e4-4343-8833-c1fd4258eda9', 'c5b48e59-0beb-46e3-832e-194491e29eb0', '2c9b33ad-c769-4d3a-8403-1752324e8048'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:21 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:21 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:22 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.004s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Deleted volume successfully. Jul 10 07:49:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e5dd41-32d6-4ee4-83f8-37e135bcdaca tempest-VolumeSnapshotQuotasNegativeTestJSON-1110909927 None] Lock "cinder-bfbd6fa9-70cb-4589-b6f1-980cbf184de1-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:31 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:DELETE=3,cinder:INSERT=6,cinder:UPDATE=23,cinder:SELECT=17 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:49:32 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=18,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Flow 'volume_create_manager' (44c37f04-fa1e-41c0-9dcb-46b577fb7aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9613ad-4f45-476d-8d59-11f919768055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9613ad-4f45-476d-8d59-11f919768055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1649990870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc805c4-4de0-44b1-8512-e7928b5106a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c5d60922784849a60b0ad62f5fa690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:35Z,use_quota=True,user_id='ea6b521c4c8d4200854231ef1a0baf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec424ad8-c348-4163-b43a-d35d2cee43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec424ad8-c348-4163-b43a-d35d2cee43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60220099-d295-4921-b748-f5b962ab7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60220099-d295-4921-b748-f5b962ab7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc805c4-4de0-44b1-8512-e7928b5106a5', 'volume_name': 'volume-8bc805c4-4de0-44b1-8512-e7928b5106a5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c90dbc6-9704-48cd-b4db-7f68c0dcd9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c90dbc6-9704-48cd-b4db-7f68c0dcd9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a46fd0a-b074-4a4e-bbe6-10e686edc2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Volume 8bc805c4-4de0-44b1-8512-e7928b5106a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc805c4-4de0-44b1-8512-e7928b5106a5', 'volume_size': 1} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1649990870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc805c4-4de0-44b1-8512-e7928b5106a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c5d60922784849a60b0ad62f5fa690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:35Z,use_quota=True,user_id='ea6b521c4c8d4200854231ef1a0baf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Creating volume 8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:35 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 1073741824 Jul 10 07:49:35 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:36 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:36 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:36 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 1073741824" returned: 0 in 1.615s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:36 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 Jul 10 07:49:36 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:37 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:49:37 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5" returned: 0 in 0.752s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a46fd0a-b074-4a4e-bbe6-10e686edc2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc805c4-4de0-44b1-8512-e7928b5106a5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f4337c-4319-4b51-938e-821a172db720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Volume volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 (8bc805c4-4de0-44b1-8512-e7928b5106a5): created successfully Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f4337c-4319-4b51-938e-821a172db720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Flow 'volume_create_manager' (44c37f04-fa1e-41c0-9dcb-46b577fb7aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e20109e2-41c6-466c-857b-cb612683b975 tempest-SnapshotMetadataTestJSON-1710989475 None] Created volume successfully. Jul 10 07:49:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Creating offline snapshot c75c8ebf-1af8-4625-a823-398e99c0f6cf of volume 8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:49:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3edddb-6f75-41e6-af67-f3168a6d6a72]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:38 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 Jul 10 07:49:38 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:39 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5" returned: 0 in 0.968s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:39 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf 1G Jul 10 07:49:39 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:40 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf 1G" returned: 0 in 0.894s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:40 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf Jul 10 07:49:40 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:41 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf" returned: 0 in 1.413s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf is being set with open permissions: ugo+rw Jul 10 07:49:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:41 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf Jul 10 07:49:41 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:42 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf" returned: 0 in 1.014s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:42 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info Jul 10 07:49:42 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:43 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info" returned: 0 in 1.050s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:43 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info is being set with open permissions: ugo+rw Jul 10 07:49:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:43 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info Jul 10 07:49:43 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:44 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.info" returned: 0 in 1.162s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.649s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5567fd09-6159-4e53-9404-26223ca2193f tempest-SnapshotMetadataTestJSON-1710989475 None] Create snapshot completed successfully Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (635383a2-3d51-415e-b2ea-78e678ecb785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c368391-289e-475f-abaf-96efa242364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c368391-289e-475f-abaf-96efa242364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2134461443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd5578f-c1cf-43df-bcc3-5434b5f44c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde92b120c504b88809f7e5dd4f6c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:46Z,use_quota=True,user_id='7e150955ebc549c89fcaf1933b83cb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10179b55-07d7-4e6e-9c0c-4d3d651ea1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10179b55-07d7-4e6e-9c0c-4d3d651ea1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8328faf6-21b8-423a-a7ee-23ad4fef3300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8328faf6-21b8-423a-a7ee-23ad4fef3300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd5578f-c1cf-43df-bcc3-5434b5f44c73', 'volume_name': 'volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4775b36-b411-4d67-95c9-78f56628faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4775b36-b411-4d67-95c9-78f56628faf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614c24f-5c29-465a-be82-8133fc8dac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73', 'volume_size': 1} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2134461443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd5578f-c1cf-43df-bcc3-5434b5f44c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde92b120c504b88809f7e5dd4f6c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:49:46Z,use_quota=True,user_id='7e150955ebc549c89fcaf1933b83cb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Creating volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:49:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:46 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 1073741824 Jul 10 07:49:46 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "cinder-c75c8ebf-1af8-4625-a823-398e99c0f6cf-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-c75c8ebf-1af8-4625-a823-398e99c0f6cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "cinder-quobyte-c75c8ebf-1af8-4625-a823-398e99c0f6cf" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-c75c8ebf-1af8-4625-a823-398e99c0f6cf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Deleting offline snapshot c75c8ebf-1af8-4625-a823-398e99c0f6cf of volume 8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] snapshot_file for this snap is: volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70231983-0ea0-44de-bc21-024383cbc896]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:46 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf Jul 10 07:49:46 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:47 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 1073741824" returned: 0 in 1.009s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:47 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 Jul 10 07:49:47 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:47 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf" returned: 0 in 0.888s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bc805c4-4de0-44b1-8512-e7928b5106a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5ac7fc-a0df-4a8a-9eef-74eb42c070f5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:47 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 Jul 10 07:49:47 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:48 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614c24f-5c29-465a-be82-8133fc8dac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252f9101-f679-4855-a8f9-c1ca5d7acf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:49:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Volume volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 (1bd5578f-c1cf-43df-bcc3-5434b5f44c73): created successfully Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252f9101-f679-4855-a8f9-c1ca5d7acf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (635383a2-3d51-415e-b2ea-78e678ecb785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:49:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-99e86642-eca2-433e-a2af-58427f31252b tempest-VolumesDeleteCascade-1405232084 None] Created volume successfully. Jul 10 07:49:48 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:48 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf Jul 10 07:49:48 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:49 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:49 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf Jul 10 07:49:49 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Creating offline snapshot be6e8c32-352f-482b-8514-e244b57ea900 of volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57f378-713e-4cc5-9076-dd92aad95ed3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:49 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 Jul 10 07:49:49 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:50 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5.c75c8ebf-1af8-4625-a823-398e99c0f6cf" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-c75c8ebf-1af8-4625-a823-398e99c0f6cf" released by "_delete_snapshot" :: held 3.541s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" released by "delete_snapshot" :: held 3.572s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Created reservations ['22477c11-b335-4946-ab1a-3ec46dd23df1', '4e1afe22-f486-4084-b5fb-5547b13d53bc', 'f54d5519-5d3c-41f9-a59d-04f03dfa1101', 'dce5dada-241f-4e03-a7ce-883e9ff88abb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Delete snapshot completed successfully. Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c821364c-f49e-4dfc-b9ae-cf3082a0f206 tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-c75c8ebf-1af8-4625-a823-398e99c0f6cf-delete_snapshot" released by "delete_snapshot" :: held 3.727s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:50 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:50 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 1G Jul 10 07:49:50 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "cinder-8bc805c4-4de0-44b1-8512-e7928b5106a5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-8bc805c4-4de0-44b1-8512-e7928b5106a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d75d376-1bdd-49cf-8a7f-6fe10e4a2c12]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:51 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 Jul 10 07:49:51 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:51 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 1G" returned: 0 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:51 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:49:51 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:52 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:52 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:52 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 is being set with open permissions: ugo+rw Jul 10 07:49:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:52 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5 Jul 10 07:49:52 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:52 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:49:52 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:53 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:53 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info Jul 10 07:49:53 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:53 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8bc805c4-4de0-44b1-8512-e7928b5106a5" returned: 0 in 1.198s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-quobyte-8bc805c4-4de0-44b1-8512-e7928b5106a5" released by "delete_volume" :: held 2.201s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Created reservations ['45878b9c-4ccb-4f95-8970-198d7955c05b', 'c16ec79a-8f55-415d-a18c-e49d6c667785', '36d07a42-4aeb-4078-aa20-c5d25430e908', 'd830da07-e687-4448-9e7c-de47ec3eaf88'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:53 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:49:53 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:54 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:54 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info is being set with open permissions: ugo+rw Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:54 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info Jul 10 07:49:54 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:54 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:49:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Deleted volume successfully. Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a6827ca-e113-4302-8f29-50073880e02c tempest-SnapshotMetadataTestJSON-1710989475 None] Lock "cinder-8bc805c4-4de0-44b1-8512-e7928b5106a5-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:49:54 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.info" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.366s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-24305b63-1831-4b31-9893-5dfb5a08ac80 tempest-VolumesDeleteCascade-1405232084 None] Create snapshot completed successfully Jul 10 07:49:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:49:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:49:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Creating offline snapshot 1a3c3aad-6567-4911-8a35-2d8794080f13 of volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:49:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70868d12-a61a-4df6-9238-87efdef9eb42]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:49:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:56 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:49:56 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:57 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 1.123s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:49:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:57 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 1G Jul 10 07:49:57 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:58 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 1G" returned: 0 in 0.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:58 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 Jul 10 07:49:58 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:59 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 is being set with open permissions: ugo+rw Jul 10 07:49:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:49:59 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 Jul 10 07:49:59 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:49:59 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 10 07:49:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:49:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.632s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:49:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f215357c-c1d3-404b-8dd5-e3f10e9ccba9 tempest-VolumesDeleteCascade-1405232084 None] Create snapshot completed successfully Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-1bd5578f-c1cf-43df-bcc3-5434b5f44c73-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-1bd5578f-c1cf-43df-bcc3-5434b5f44c73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Performing cascade delete. {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-1a3c3aad-6567-4911-8a35-2d8794080f13-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-1a3c3aad-6567-4911-8a35-2d8794080f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-1a3c3aad-6567-4911-8a35-2d8794080f13" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1a3c3aad-6567-4911-8a35-2d8794080f13" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Deleting offline snapshot 1a3c3aad-6567-4911-8a35-2d8794080f13 of volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] snapshot_file for this snap is: volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5d11b1-0042-45fa-9c13-e98890bc59f8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:00 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 Jul 10 07:50:00 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:01 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:50:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ccea5-8c1c-4c6b-859e-58c83c761fa0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:01 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:50:01 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:02 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:02 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 Jul 10 07:50:02 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Acquiring lock "cinder-80cbbfcc-004e-4144-a654-c6feaab308ff-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "cinder-80cbbfcc-004e-4144-a654-c6feaab308ff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Acquiring lock "cinder-quobyte-80cbbfcc-004e-4144-a654-c6feaab308ff" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "cinder-quobyte-80cbbfcc-004e-4144-a654-c6feaab308ff" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49ec5d-5d43-4edd-a5bb-51fcd06b7f54]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:02 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff Jul 10 07:50:02 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:03 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13" returned: 0 in 0.967s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:03 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13 Jul 10 07:50:03 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:03 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:03 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff Jul 10 07:50:03 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:04 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-80cbbfcc-004e-4144-a654-c6feaab308ff" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:04 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.1a3c3aad-6567-4911-8a35-2d8794080f13" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "cinder-quobyte-80cbbfcc-004e-4144-a654-c6feaab308ff" released by "delete_volume" :: held 1.771s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1a3c3aad-6567-4911-8a35-2d8794080f13" released by "_delete_snapshot" :: held 3.739s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" released by "delete_snapshot" :: held 3.766s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Created reservations ['f4b0fe76-a517-41cf-9eda-4dce6e9c66aa', 'ef5066d0-34c2-4b72-a86c-5905655cb9cd', '2a6ca8ee-4b2a-45ad-b255-f87c826381bc', '1992a532-67ae-418d-a2be-32d3114c5bab'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['73880128-3d15-40aa-b166-b5149a270fb9', 'cdde4397-bbb5-4108-9529-604762a938e6', '0bcd229a-877c-4cb2-992b-ba84c6ba0d02', 'f7279ee4-7144-4d67-9eeb-76dd44bce9c1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:04 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:04 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Delete snapshot completed successfully. Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-1a3c3aad-6567-4911-8a35-2d8794080f13-delete_snapshot" released by "delete_snapshot" :: held 3.995s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-be6e8c32-352f-482b-8514-e244b57ea900-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-be6e8c32-352f-482b-8514-e244b57ea900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-be6e8c32-352f-482b-8514-e244b57ea900" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-be6e8c32-352f-482b-8514-e244b57ea900" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Deleting offline snapshot be6e8c32-352f-482b-8514-e244b57ea900 of volume 1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] snapshot_file for this snap is: volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202b150-4aef-494c-b14a-709d7a17d819]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:05 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:50:05 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:05 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Deleted volume successfully. Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-802f3c0a-3db8-4ac4-a4f2-454c82af896f tempest-AttachVolumeShelveTestJSON-567619578 None] Lock "cinder-80cbbfcc-004e-4144-a654-c6feaab308ff-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:05 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 1.095s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f532579e-4b5e-43e5-b14f-70e7bb5f91e0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:06 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 Jul 10 07:50:06 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:06 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" returned: 0 in 0.883s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:06 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:50:06 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:07 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:07 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900 Jul 10 07:50:07 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:08 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73.be6e8c32-352f-482b-8514-e244b57ea900" returned: 0 in 1.004s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-be6e8c32-352f-482b-8514-e244b57ea900" released by "_delete_snapshot" :: held 3.915s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" released by "delete_snapshot" :: held 3.938s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (d8f6c3fe-6ff4-42f5-8566-1f7efb4ef2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbe28a9-91d8-4cab-b7ef-e7aab35c4938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbe28a9-91d8-4cab-b7ef-e7aab35c4938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-639345199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ed2375-0024-4dc3-8ed4-b229c96fdc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:09Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296293f3-549b-43e1-a70c-9e0c5f72c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296293f3-549b-43e1-a70c-9e0c5f72c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70af1e40-a0a0-44f1-95a2-efa24651ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70af1e40-a0a0-44f1-95a2-efa24651ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ed2375-0024-4dc3-8ed4-b229c96fdc8e', 'volume_name': 'volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b6f89-6af0-4cd4-b451-53a65b81bbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b6f89-6af0-4cd4-b451-53a65b81bbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5863ac7e-8d86-4977-a912-0a45d11910b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Volume 66ed2375-0024-4dc3-8ed4-b229c96fdc8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e', 'volume_size': 1} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-639345199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ed2375-0024-4dc3-8ed4-b229c96fdc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc49a74c9bc4e24835e1bebf98df0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:09Z,use_quota=True,user_id='56dd096c35dd44e78881d6fa7d2f8d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Creating volume 66ed2375-0024-4dc3-8ed4-b229c96fdc8e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:50:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:08 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e 1073741824 Jul 10 07:50:08 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['52704825-ee38-49e6-b11b-ef68d417fa59', '5126a0aa-1e62-4fd1-8969-c272dce9fd12', '7a14d23b-e941-4042-9cc8-d916304dc7d3', '018d5ff9-b7b6-42cc-ac63-01747d77ad30'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Delete snapshot completed successfully. Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-be6e8c32-352f-482b-8514-e244b57ea900-delete_snapshot" released by "delete_snapshot" :: held 4.308s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Snapshots deleted, issuing volume delete {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[08452339-ab9c-48e0-a0fa-cad83181feef]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:09 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 Jul 10 07:50:09 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:10 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:10 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e 1073741824" returned: 0 in 1.330s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:10 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73 Jul 10 07:50:10 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:10 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e Jul 10 07:50:10 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:11 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" returned: 0 in 0.894s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:11 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-1bd5578f-c1cf-43df-bcc3-5434b5f44c73" released by "delete_volume" :: held 2.069s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5863ac7e-8d86-4977-a912-0a45d11910b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b30181-ddc4-41e0-bb9c-b873c738c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Volume volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e (66ed2375-0024-4dc3-8ed4-b229c96fdc8e): created successfully Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b30181-ddc4-41e0-bb9c-b873c738c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Flow 'volume_create_manager' (d8f6c3fe-6ff4-42f5-8566-1f7efb4ef2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef225eea-c618-45e8-85ec-f6036955e077 tempest-AttachVolumeNegativeTest-1771272357 None] Created volume successfully. Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['670f404e-8681-47e7-933b-44604542b95d', 'f9ea2295-9bb1-488d-8c15-5b2440368d36', '2c06354e-4e69-475e-b44a-c0d7694d1308', '34a0b44a-82ed-4ede-9395-8de379023046'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:11 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:11 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:12 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.810s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Deleted volume successfully. Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-151ffccc-3685-4b3c-bbf0-07f461ca6f4c tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-1bd5578f-c1cf-43df-bcc3-5434b5f44c73-delete_volume" released by "delete_volume" :: held 11.540s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (4cdcbfac-5fef-432e-8cbe-fcbf15b96212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96144465-69ad-433b-b747-08a9487d1ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96144465-69ad-433b-b747-08a9487d1ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1362755895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca69ac-09da-4c17-97b4-a46d6b3eb66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde92b120c504b88809f7e5dd4f6c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:13Z,use_quota=True,user_id='7e150955ebc549c89fcaf1933b83cb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0c4c7-ed2a-40b9-bea1-81cb3f274327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0c4c7-ed2a-40b9-bea1-81cb3f274327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd1adb3-b686-4ac2-95e2-8574b0e3a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd1adb3-b686-4ac2-95e2-8574b0e3a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ca69ac-09da-4c17-97b4-a46d6b3eb66b', 'volume_name': 'volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a82816-87a6-4624-941b-b673d6f3690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a82816-87a6-4624-941b-b673d6f3690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fef238-57b0-4ebd-8ae6-14a426343709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Volume 21ca69ac-09da-4c17-97b4-a46d6b3eb66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b', 'volume_size': 1} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1362755895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca69ac-09da-4c17-97b4-a46d6b3eb66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde92b120c504b88809f7e5dd4f6c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:13Z,use_quota=True,user_id='7e150955ebc549c89fcaf1933b83cb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Creating volume 21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:50:12 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:50:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:12 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b 1073741824 Jul 10 07:50:12 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:13 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b 1073741824" returned: 0 in 1.002s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:13 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:13 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Flow 'volume_create_manager' (281e617a-b570-43b2-9a8e-583db5d266c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5233e09-cffb-4369-bfa5-6f26d057ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5233e09-cffb-4369-bfa5-6f26d057ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743259428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bdc450-399e-44f8-8630-7ad191357706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144a8d96264546449497250bbb75905f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:14Z,use_quota=True,user_id='82e04c42105848aba11efb18db257d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1bea72-55bd-41bb-b904-6c5661dbe5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1bea72-55bd-41bb-b904-6c5661dbe5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd44d80-5960-41bb-96d3-46b4b147f900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd44d80-5960-41bb-96d3-46b4b147f900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51bdc450-399e-44f8-8630-7ad191357706', 'volume_name': 'volume-51bdc450-399e-44f8-8630-7ad191357706', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629f5828-e81a-41db-9b5d-9baf9e2a71e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629f5828-e81a-41db-9b5d-9baf9e2a71e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622fbf2f-91f0-4a0f-a731-a37b8948c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Volume 51bdc450-399e-44f8-8630-7ad191357706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51bdc450-399e-44f8-8630-7ad191357706', 'volume_size': 1} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:14 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-743259428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bdc450-399e-44f8-8630-7ad191357706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144a8d96264546449497250bbb75905f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:14Z,use_quota=True,user_id='82e04c42105848aba11efb18db257d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Creating volume 51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:50:14 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:14 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 1073741824 Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fef238-57b0-4ebd-8ae6-14a426343709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca7ed3-4903-4a2d-9bb5-d3750539cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Volume volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b (21ca69ac-09da-4c17-97b4-a46d6b3eb66b): created successfully Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca7ed3-4903-4a2d-9bb5-d3750539cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (4cdcbfac-5fef-432e-8cbe-fcbf15b96212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-590d42dd-3292-4dba-8f2c-8132c36d47a2 tempest-VolumesDeleteCascade-1405232084 None] Created volume successfully. Jul 10 07:50:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:15 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 1073741824" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:15 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:50:15 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:16 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.118s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622fbf2f-91f0-4a0f-a731-a37b8948c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51bdc450-399e-44f8-8630-7ad191357706', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5559ca-305f-48db-b888-d2519fa78656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd0007-4f6b-485b-89c2-98dde79ca59f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Volume volume-51bdc450-399e-44f8-8630-7ad191357706 (51bdc450-399e-44f8-8630-7ad191357706): created successfully Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5559ca-305f-48db-b888-d2519fa78656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Flow 'volume_create_manager' (281e617a-b570-43b2-9a8e-583db5d266c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5c4b2b83-cd4d-476a-9a7e-05366e4c1374 tempest-VolumesActionsTest-1182214777 None] Created volume successfully. Jul 10 07:50:16 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e Jul 10 07:50:16 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:17 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.988s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Creating offline snapshot 20317363-5771-4da5-a84a-054115bbb25e of volume 21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3445c-a0c3-4fb1-aa40-7b535ac78e76]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43f858a7-49fa-4410-9953-26e9904329a4', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:50:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9b3820e8-35a6-4e14-b85e-b78d13364a43 req-c5e170fe-00ff-4afb-84d6-b40959172358 tempest-AttachVolumeNegativeTest-1771272357 None] attachment_update completed successfully. Jul 10 07:50:17 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:17 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:18 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 1.055s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:18 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e 1G Jul 10 07:50:18 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:19 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e 1G" returned: 0 in 1.098s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:19 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:19 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:20 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e is being set with open permissions: ugo+rw Jul 10 07:50:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:20 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:20 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:20 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:20 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info Jul 10 07:50:20 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:21 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:21 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info is being set with open permissions: ugo+rw Jul 10 07:50:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:21 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info Jul 10 07:50:21 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:22 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.info" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.490s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-626fdb06-391b-4b62-b0d4-fc8623b13cf9 tempest-VolumesDeleteCascade-1405232084 None] Create snapshot completed successfully Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (1a622ef8-7c7f-4439-aed1-7761a431f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbbb9bf-9dfa-4390-84c6-7f81aa910d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbbb9bf-9dfa-4390-84c6-7f81aa910d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902610865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e526b1a9-444d-4895-93a8-62e35a9bb5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde92b120c504b88809f7e5dd4f6c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20317363-5771-4da5-a84a-054115bbb25e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:24Z,use_quota=True,user_id='7e150955ebc549c89fcaf1933b83cb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfb2e0-476d-4320-ae3e-984332575b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfb2e0-476d-4320-ae3e-984332575b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580a9a4-ddcc-4757-bc21-9af2a1d07968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580a9a4-ddcc-4757-bc21-9af2a1d07968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e526b1a9-444d-4895-93a8-62e35a9bb5c3', 'volume_name': 'volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3', 'volume_size': 1, 'snapshot_id': '20317363-5771-4da5-a84a-054115bbb25e'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ac9ff5-3772-4d98-be52-b72faa9e8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ac9ff5-3772-4d98-be52-b72faa9e8581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dabd48f-42e3-4cf6-b566-96e882cb4fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Volume e526b1a9-444d-4895-93a8-62e35a9bb5c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3', 'volume_size': 1, 'snapshot_id': '20317363-5771-4da5-a84a-054115bbb25e'} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e-e526b1a9-444d-4895-93a8-62e35a9bb5c3" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-e7eaeaec-3fc1-407f-9a6e-147fd28045a2 req-22becb60-3268-4c38-a29f-67ef58063e22 tempest-AttachVolumeNegativeTest-1771272357 None] Terminate volume connection completed successfully. Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-e7eaeaec-3fc1-407f-9a6e-147fd28045a2 req-22becb60-3268-4c38-a29f-67ef58063e22 tempest-AttachVolumeNegativeTest-1771272357 None] Deleting attachment 43f858a7-49fa-4410-9953-26e9904329a4. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e-e526b1a9-444d-4895-93a8-62e35a9bb5c3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Creating volume e526b1a9-444d-4895-93a8-62e35a9bb5c3 from snapshot 20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] snapshot: 20317363-5771-4da5-a84a-054115bbb25e, volume: e526b1a9-444d-4895-93a8-62e35a9bb5c3, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5e882-827b-478f-b86e-f31c06308e2b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:24 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:24 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:25 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4426f69-49b6-4e83-91c1-f1b7e3eb9c13]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:25 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:25 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:26 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:26 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:50:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:26 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 Jul 10 07:50:26 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:34 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=73,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:50:34 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3" returned: 0 in 8.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dfda3f-3e50-45bd-a139-1f1951802aba]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:34 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=64,cinder:SELECT=52,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:50:34 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:34 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:36 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 1.662s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:50:36 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Converted 1024.00 MB image at 127.12 MB/s Jul 10 07:50:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 is being set with open permissions: ugo+rw Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:36 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 Jul 10 07:50:36 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-580fb962-a6fa-4575-9a9d-401559fd1023 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-580fb962-a6fa-4575-9a9d-401559fd1023 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" acquired by "attach_volume" :: waited 0.075s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:36 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:36 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-580fb962-a6fa-4575-9a9d-401559fd1023 tempest-VolumesActionsTest-1182214777 None] Attaching volume 51bdc450-399e-44f8-8630-7ad191357706 to instance a6c0966c-b368-41a8-bb2d-d6cfa91b155d at mountpoint /dev/vdb on host None. Jul 10 07:50:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-580fb962-a6fa-4575-9a9d-401559fd1023 tempest-VolumesActionsTest-1182214777 None] Attach volume completed successfully. Jul 10 07:50:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-580fb962-a6fa-4575-9a9d-401559fd1023 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" released by "attach_volume" :: held 0.200s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:37 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ded9ba4-8581-4893-9c75-8a0a442f517c tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" released by "_copy_volume_from_snapshot" :: held 12.601s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e-e526b1a9-444d-4895-93a8-62e35a9bb5c3" released by "_create_volume_from_snapshot" :: held 12.649s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.673s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ded9ba4-8581-4893-9c75-8a0a442f517c tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3ded9ba4-8581-4893-9c75-8a0a442f517c tempest-VolumesActionsTest-1182214777 None] Detaching volume 51bdc450-399e-44f8-8630-7ad191357706 from instance a6c0966c-b368-41a8-bb2d-d6cfa91b155d. Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dabd48f-42e3-4cf6-b566-96e882cb4fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3', 'volume_size': 1, 'snapshot_id': '20317363-5771-4da5-a84a-054115bbb25e'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdfc7e8-2563-41dd-bfb0-489a61919a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Volume volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 (e526b1a9-444d-4895-93a8-62e35a9bb5c3): created successfully Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdfc7e8-2563-41dd-bfb0-489a61919a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Flow 'volume_create_manager' (1a622ef8-7c7f-4439-aed1-7761a431f37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-115f35c5-b01d-456c-b6ba-9db960aca3bc tempest-VolumesDeleteCascade-1405232084 None] Created volume successfully. Jul 10 07:50:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3ded9ba4-8581-4893-9c75-8a0a442f517c tempest-VolumesActionsTest-1182214777 None] Detach volume completed successfully. Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ded9ba4-8581-4893-9c75-8a0a442f517c tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:37 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.953s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:50:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-21ca69ac-09da-4c17-97b4-a46d6b3eb66b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-21ca69ac-09da-4c17-97b4-a46d6b3eb66b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Performing cascade delete. {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-20317363-5771-4da5-a84a-054115bbb25e-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-20317363-5771-4da5-a84a-054115bbb25e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Deleting offline snapshot 20317363-5771-4da5-a84a-054115bbb25e of volume 21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] snapshot_file for this snap is: volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f016fd-9e87-4dc4-a750-74d2ec4356d3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:38 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:38 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-66ed2375-0024-4dc3-8ed4-b229c96fdc8e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-66ed2375-0024-4dc3-8ed4-b229c96fdc8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-quobyte-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc685d5-cc45-4408-be62-6bb1a974d028]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:39 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e Jul 10 07:50:39 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:39 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9d051-d748-4306-b24a-94ea6ed359ea]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:39 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:39 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:40 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" returned: 0 in 1.170s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:40 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e Jul 10 07:50:40 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:40 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 1.194s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:40 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:40 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:41 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" returned: 0 in 1.134s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-66ed2375-0024-4dc3-8ed4-b229c96fdc8e" released by "delete_volume" :: held 2.366s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Created reservations ['32b63193-3e7e-4744-839a-b728bca41098', '99a7ceef-16f8-4dc9-acab-8b84a8798ca0', '75d78741-9d32-4287-9f83-4fc440d47cc7', 'ad0acbac-9990-4538-b79e-b914ef4f6cbb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:41 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:41 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:42 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 1.201s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:42 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e Jul 10 07:50:42 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:42 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Deleted volume successfully. Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2fcaec8-9742-4a23-8400-ddd1c3380444 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-66ed2375-0024-4dc3-8ed4-b229c96fdc8e-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:42 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b.20317363-5771-4da5-a84a-054115bbb25e" returned: 0 in 0.755s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-20317363-5771-4da5-a84a-054115bbb25e" released by "_delete_snapshot" :: held 4.302s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" released by "delete_snapshot" :: held 4.337s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-138998e6-ceee-4c67-95f6-4b0efac06602-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-138998e6-ceee-4c67-95f6-4b0efac06602-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-quobyte-138998e6-ceee-4c67-95f6-4b0efac06602" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-138998e6-ceee-4c67-95f6-4b0efac06602" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['cf9eb25e-476f-4129-aa30-9507ba779e9e', 'd97b5e21-a298-4680-a2a2-8a6a16199bc3', '2e6f3faa-0a9a-4ceb-8a53-f0f10fd6b9b3', '9d863c03-5973-45d9-8fe7-144f51700c54'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a68c94-9a6b-4a87-b65f-3ba2754593c7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Delete snapshot completed successfully. Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-20317363-5771-4da5-a84a-054115bbb25e-delete_snapshot" released by "delete_snapshot" :: held 4.775s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Snapshots deleted, issuing volume delete {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f2c5ee-6d4e-4d33-9543-b0fcf30c7da3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:43 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 Jul 10 07:50:43 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:43 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:43 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:44 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602" returned: 0 in 0.992s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:44 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602 Jul 10 07:50:44 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:44 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 0.905s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:44 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b Jul 10 07:50:44 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:45 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-138998e6-ceee-4c67-95f6-4b0efac06602" returned: 0 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-138998e6-ceee-4c67-95f6-4b0efac06602" released by "delete_volume" :: held 2.022s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:45 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-21ca69ac-09da-4c17-97b4-a46d6b3eb66b" released by "delete_volume" :: held 1.886s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Created reservations ['d771e39c-72c2-4a4b-a0a9-279734477c2a', '5334289e-d50f-4a6e-8f2b-e250f8270b23', '6e920a66-e6c1-4283-b427-eadcfc0617e5', 'dd0a40e9-e282-4e34-9fa0-cbc5cba5224e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['d7967949-9920-43bd-a335-520ead7c8b31', 'ab088838-a7d5-4bd5-bc0b-3d83fcbaf40b', '09d159a6-0426-464c-a823-adfc00c206e1', '471d4e00-bbb8-42ba-830d-8ae880575949'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:45 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:45 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:45 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:45 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:46 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Deleted volume successfully. Jul 10 07:50:46 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Deleted volume successfully. Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5ad3794e-4c7c-495a-8f5d-1eb6c5cf78e1 tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-138998e6-ceee-4c67-95f6-4b0efac06602-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b17b431f-e1db-4acb-a5c2-8816585f5940 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-21ca69ac-09da-4c17-97b4-a46d6b3eb66b-delete_volume" released by "delete_volume" :: held 7.908s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-e526b1a9-444d-4895-93a8-62e35a9bb5c3-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-e526b1a9-444d-4895-93a8-62e35a9bb5c3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[806109d0-b574-4447-84b4-26f981c857d2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-8a7284ce-c469-4d54-ae5b-371f72b9311a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-8a7284ce-c469-4d54-ae5b-371f72b9311a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:46 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 Jul 10 07:50:46 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "cinder-quobyte-8a7284ce-c469-4d54-ae5b-371f72b9311a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-8a7284ce-c469-4d54-ae5b-371f72b9311a" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[494ab7d2-c350-49d3-bfcc-c9f655dbbbd1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:47 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a Jul 10 07:50:47 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:47 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3" returned: 0 in 1.268s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:48 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3 Jul 10 07:50:48 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:48 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a" returned: 0 in 1.312s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:48 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a Jul 10 07:50:48 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:48 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e526b1a9-444d-4895-93a8-62e35a9bb5c3" returned: 0 in 0.837s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-quobyte-e526b1a9-444d-4895-93a8-62e35a9bb5c3" released by "delete_volume" :: held 2.174s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Created reservations ['351ccd14-4ae1-48ef-ae87-2654ca2d73fd', 'fff5c894-f172-450c-b2b7-2b3225eaeb8a', 'b791b1ae-9714-4184-af44-ba9057c09828', 'ef3ed911-73ed-4473-9c66-048d7e563e4b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:49 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8a7284ce-c469-4d54-ae5b-371f72b9311a" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:49 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:49 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-quobyte-8a7284ce-c469-4d54-ae5b-371f72b9311a" released by "delete_volume" :: held 2.238s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Created reservations ['6e0a2f3a-4ca0-4df2-8fda-6d9f678ed43a', '6a237502-e824-4778-808c-aca0b45d8b10', 'a69e5947-3890-4645-895d-4acb5a98d2f3', '160ce66a-48da-4c28-a253-28957b9bb5e1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:49 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:50:49 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:50 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Deleted volume successfully. Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b34b8cfd-c167-42dd-a8f4-80da4476ca20 tempest-VolumesDeleteCascade-1405232084 None] Lock "cinder-e526b1a9-444d-4895-93a8-62e35a9bb5c3-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:50 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:50:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Deleted volume successfully. Jul 10 07:50:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-042c31b3-04c8-4d82-8b5f-661f147f52df tempest-AttachVolumeNegativeTest-1771272357 None] Lock "cinder-8a7284ce-c469-4d54-ae5b-371f72b9311a-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Flow 'volume_create_manager' (07d6ce2b-1a2d-478c-9298-7b499674121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076c482-cb76-456d-a744-5dc6bbc594f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076c482-cb76-456d-a744-5dc6bbc594f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1321396830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69555137-6c78-436d-bcb1-91bbe555fd99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e589c5ff8a724131b963068c6981d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:54Z,use_quota=True,user_id='8dddb536f1fb494fa275dcf92823eb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c0d5a0-490c-4fc4-baa7-2e3b04b49b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c0d5a0-490c-4fc4-baa7-2e3b04b49b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa4446-f059-4657-9afd-27e8f8d19cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa4446-f059-4657-9afd-27e8f8d19cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69555137-6c78-436d-bcb1-91bbe555fd99', 'volume_name': 'volume-69555137-6c78-436d-bcb1-91bbe555fd99', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1f0d2a-0b49-44be-8562-3c6ae4ad6bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1f0d2a-0b49-44be-8562-3c6ae4ad6bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5074e2f7-bc4f-4d83-8d01-814a8ac31f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Volume 69555137-6c78-436d-bcb1-91bbe555fd99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69555137-6c78-436d-bcb1-91bbe555fd99', 'volume_size': 1} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1321396830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69555137-6c78-436d-bcb1-91bbe555fd99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e589c5ff8a724131b963068c6981d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:50:54Z,use_quota=True,user_id='8dddb536f1fb494fa275dcf92823eb42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Creating volume 69555137-6c78-436d-bcb1-91bbe555fd99 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:50:54 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:50:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:55 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 1073741824 Jul 10 07:50:55 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:56 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 1073741824" returned: 0 in 1.541s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:56 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 Jul 10 07:50:56 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:57 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5074e2f7-bc4f-4d83-8d01-814a8ac31f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69555137-6c78-436d-bcb1-91bbe555fd99', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daac3db0-50ad-4419-8d75-857f6a56a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:50:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Volume volume-69555137-6c78-436d-bcb1-91bbe555fd99 (69555137-6c78-436d-bcb1-91bbe555fd99): created successfully Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daac3db0-50ad-4419-8d75-857f6a56a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:50:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Flow 'volume_create_manager' (07d6ce2b-1a2d-478c-9298-7b499674121a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:50:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-690d25a8-7bf3-4ab2-bbe1-7f9e182c80d9 tempest-VolumesMetadataTest-1067582189 None] Created volume successfully. Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Acquiring lock "cinder-69555137-6c78-436d-bcb1-91bbe555fd99-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "cinder-69555137-6c78-436d-bcb1-91bbe555fd99-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Acquiring lock "cinder-quobyte-69555137-6c78-436d-bcb1-91bbe555fd99" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "cinder-quobyte-69555137-6c78-436d-bcb1-91bbe555fd99" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b9777-ab0c-46db-bd63-d41353e86546]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:50:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:58 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 Jul 10 07:50:58 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:50:59 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 10 07:50:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:50:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:50:59 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99 Jul 10 07:50:59 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:00 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-69555137-6c78-436d-bcb1-91bbe555fd99" returned: 0 in 1.111s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "cinder-quobyte-69555137-6c78-436d-bcb1-91bbe555fd99" released by "delete_volume" :: held 1.927s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Created reservations ['9f373c21-10cd-4b31-82d0-3c92752e1fc9', '44899453-7d08-42c9-a1de-7c819e20b219', '448ab8ec-1e33-44f7-8b4d-b6ddfba4961a', 'bf14c0b2-05b7-4fb1-b3e0-c42376c6f29a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (394a3672-4555-47b6-881d-aa1ee887bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88ccb4e-af5d-4d6f-9623-46170920d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88ccb4e-af5d-4d6f-9623-46170920d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712227376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de81a7f-a2c8-4149-be64-052f7a67a899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:00Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dcc7b6-30aa-4178-afe7-44e1dae04b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dcc7b6-30aa-4178-afe7-44e1dae04b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ab5440-b4df-4c31-8f55-a3f7c6ef96ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ab5440-b4df-4c31-8f55-a3f7c6ef96ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de81a7f-a2c8-4149-be64-052f7a67a899', 'volume_name': 'volume-2de81a7f-a2c8-4149-be64-052f7a67a899', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef64799-3e6a-49df-9bd4-14a1b8794c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef64799-3e6a-49df-9bd4-14a1b8794c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46eaec22-7463-4fb3-b7b0-4afe05b226a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Volume 2de81a7f-a2c8-4149-be64-052f7a67a899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de81a7f-a2c8-4149-be64-052f7a67a899', 'volume_size': 1} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712227376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de81a7f-a2c8-4149-be64-052f7a67a899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:00Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Creating volume 2de81a7f-a2c8-4149-be64-052f7a67a899 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:00 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 1073741824 Jul 10 07:51:00 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:00 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:00 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:01 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:01 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Deleted volume successfully. Jul 10 07:51:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d359a24-e6fd-4d9d-9172-98bebb144c8e tempest-VolumesMetadataTest-1067582189 None] Lock "cinder-69555137-6c78-436d-bcb1-91bbe555fd99-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:01 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 1073741824" returned: 0 in 1.147s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:01 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 Jul 10 07:51:01 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:02 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899" returned: 0 in 0.858s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46eaec22-7463-4fb3-b7b0-4afe05b226a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de81a7f-a2c8-4149-be64-052f7a67a899', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9863af-49d1-41f9-85b9-a04d00b8b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Volume volume-2de81a7f-a2c8-4149-be64-052f7a67a899 (2de81a7f-a2c8-4149-be64-052f7a67a899): created successfully Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9863af-49d1-41f9-85b9-a04d00b8b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (394a3672-4555-47b6-881d-aa1ee887bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-49c26510-6a8a-4d54-bb82-a3f6219f9934 tempest-VolumesTestJSON-1878753361 None] Created volume successfully. Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d18a9ec-b5e2-42ce-9d97-0930951d3b21 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d18a9ec-b5e2-42ce-9d97-0930951d3b21 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" acquired by "attach_volume" :: waited 0.071s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (adfd65c3-5572-427d-9153-a4a408d45619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af36c292-98ec-4bd8-93df-3013dcd480c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af36c292-98ec-4bd8-93df-3013dcd480c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-888453179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5054df34-e646-439e-9bf2-7870dd8a1c1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:04Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1879621e-580c-425e-8450-7c2715bc9181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1879621e-580c-425e-8450-7c2715bc9181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e725e10-7730-4359-8802-f323404a9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e725e10-7730-4359-8802-f323404a9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5054df34-e646-439e-9bf2-7870dd8a1c1e', 'volume_name': 'volume-5054df34-e646-439e-9bf2-7870dd8a1c1e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c6d87-92bc-4a35-b43c-1b8c46d5b745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c6d87-92bc-4a35-b43c-1b8c46d5b745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a1d70d-9b86-403a-8224-f5adf9f19cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Volume 5054df34-e646-439e-9bf2-7870dd8a1c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5054df34-e646-439e-9bf2-7870dd8a1c1e', 'volume_size': 1} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-888453179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5054df34-e646-439e-9bf2-7870dd8a1c1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:04Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Creating volume 5054df34-e646-439e-9bf2-7870dd8a1c1e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7d18a9ec-b5e2-42ce-9d97-0930951d3b21 tempest-VolumesActionsTest-1182214777 None] Attaching volume 51bdc450-399e-44f8-8630-7ad191357706 to instance c43fcf63-16b8-432c-aa70-7fdf95fea561 at mountpoint /dev/vdb on host None. Jul 10 07:51:04 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e 1073741824 Jul 10 07:51:04 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7d18a9ec-b5e2-42ce-9d97-0930951d3b21 tempest-VolumesActionsTest-1182214777 None] Attach volume completed successfully. Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d18a9ec-b5e2-42ce-9d97-0930951d3b21 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706" released by "attach_volume" :: held 0.311s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (83dcd03c-fa66-4324-ba64-465bb94a49d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f21da4-22e6-485c-8281-828b34103167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f21da4-22e6-485c-8281-828b34103167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1471065250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9786c0-b40d-4c9d-8f5c-71a14399e012,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:05Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3565bb-ad50-4b9a-a2a6-1192dbc60405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3565bb-ad50-4b9a-a2a6-1192dbc60405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc7d35a-e2db-4e3d-83a7-a7a2d18f4353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc7d35a-e2db-4e3d-83a7-a7a2d18f4353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9786c0-b40d-4c9d-8f5c-71a14399e012', 'volume_name': 'volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f2b119-f798-4b3f-b7ca-39a025a8bea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f2b119-f798-4b3f-b7ca-39a025a8bea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349fc21a-f2c5-410e-b03a-9180628e5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Volume 6a9786c0-b40d-4c9d-8f5c-71a14399e012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012', 'volume_size': 1} Jul 10 07:51:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0dd36ed2-1d23-4add-af61-210858862619 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0dd36ed2-1d23-4add-af61-210858862619 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0dd36ed2-1d23-4add-af61-210858862619 tempest-VolumesActionsTest-1182214777 None] Detaching volume 51bdc450-399e-44f8-8630-7ad191357706 from instance c43fcf63-16b8-432c-aa70-7fdf95fea561. Jul 10 07:51:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0dd36ed2-1d23-4add-af61-210858862619 tempest-VolumesActionsTest-1182214777 None] Detach volume completed successfully. Jul 10 07:51:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0dd36ed2-1d23-4add-af61-210858862619 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:05 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e 1073741824" returned: 0 in 1.139s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:05 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e Jul 10 07:51:05 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:06 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1471065250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9786c0-b40d-4c9d-8f5c-71a14399e012,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:05Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Creating volume 6a9786c0-b40d-4c9d-8f5c-71a14399e012 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a1d70d-9b86-403a-8224-f5adf9f19cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5054df34-e646-439e-9bf2-7870dd8a1c1e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:06 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 1073741824 Jul 10 07:51:06 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65729ef6-882d-47c7-98b0-a619bbea343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Volume volume-5054df34-e646-439e-9bf2-7870dd8a1c1e (5054df34-e646-439e-9bf2-7870dd8a1c1e): created successfully Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65729ef6-882d-47c7-98b0-a619bbea343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (adfd65c3-5572-427d-9153-a4a408d45619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7c8cd72a-28c0-4f3f-b315-25c115014436 tempest-VolumesListTestJSON-1554072815 None] Created volume successfully. Jul 10 07:51:07 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 1073741824" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:07 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 Jul 10 07:51:07 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (4432e26e-d04f-4765-9665-cfda3e2024a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61366ee6-6dc8-405a-8e8d-7bd6365c251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61366ee6-6dc8-405a-8e8d-7bd6365c251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-111574043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da53fdc-c095-44f9-85e4-f68128cb302b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:08Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ce999-7a5b-4023-9231-dab5218ccb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ce999-7a5b-4023-9231-dab5218ccb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32fac7b-9f69-45ad-b403-dc804fb6c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32fac7b-9f69-45ad-b403-dc804fb6c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da53fdc-c095-44f9-85e4-f68128cb302b', 'volume_name': 'volume-4da53fdc-c095-44f9-85e4-f68128cb302b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c487d20-1d54-473d-8265-24e5779a4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c487d20-1d54-473d-8265-24e5779a4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb50817-86c9-4757-b894-0321ea9d4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Volume 4da53fdc-c095-44f9-85e4-f68128cb302b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da53fdc-c095-44f9-85e4-f68128cb302b', 'volume_size': 1} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:08 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012" returned: 0 in 1.019s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-111574043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da53fdc-c095-44f9-85e4-f68128cb302b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:08Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Creating volume 4da53fdc-c095-44f9-85e4-f68128cb302b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349fc21a-f2c5-410e-b03a-9180628e5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7812e4e-fba6-4888-a3cf-dc0a1be92a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b 1073741824 Jul 10 07:51:08 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Volume volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 (6a9786c0-b40d-4c9d-8f5c-71a14399e012): created successfully Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7812e4e-fba6-4888-a3cf-dc0a1be92a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (83dcd03c-fa66-4324-ba64-465bb94a49d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cfcf380e-2ed8-4bd8-b08d-ae4a5995521d tempest-VolumesTestJSON-1878753361 None] Created volume successfully. Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (9c50cb4e-f1af-446e-99cf-f08c2433c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af5e97f-1282-488b-9659-d4d8d840c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af5e97f-1282-488b-9659-d4d8d840c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-916340932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c3c08f-40c0-4be1-8dc5-42a124d82724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:09Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058f4d47-465a-4bff-9882-372554b27259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058f4d47-465a-4bff-9882-372554b27259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68c74dc-0aef-4f7c-a586-789d7fd5c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68c74dc-0aef-4f7c-a586-789d7fd5c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c3c08f-40c0-4be1-8dc5-42a124d82724', 'volume_name': 'volume-26c3c08f-40c0-4be1-8dc5-42a124d82724', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa7ca8e-e4ee-4d91-9340-c989f1b6ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa7ca8e-e4ee-4d91-9340-c989f1b6ec93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140e6b1-a3a0-45c0-b36f-c209a9058ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Volume 26c3c08f-40c0-4be1-8dc5-42a124d82724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c3c08f-40c0-4be1-8dc5-42a124d82724', 'volume_size': 1} Jul 10 07:51:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:09 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b 1073741824" returned: 0 in 1.089s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:09 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b Jul 10 07:51:09 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (2280efbe-17b9-4089-b107-0b1a212ba21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f05a575-a6ab-492f-9a60-5b6e21f944fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f05a575-a6ab-492f-9a60-5b6e21f944fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1566468739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930a0992-2b90-4886-8f41-bb35f60a998a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:10Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0c8984-2f0d-4a7c-a52f-d4b8c89fec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0c8984-2f0d-4a7c-a52f-d4b8c89fec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5efd3a-07e6-48b7-8091-271040c9b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5efd3a-07e6-48b7-8091-271040c9b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930a0992-2b90-4886-8f41-bb35f60a998a', 'volume_name': 'volume-930a0992-2b90-4886-8f41-bb35f60a998a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0399dc-d8b8-4785-a81d-e1c46dad83e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0399dc-d8b8-4785-a81d-e1c46dad83e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1f0032-0447-4ab0-a918-d2dc7b079830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Volume 930a0992-2b90-4886-8f41-bb35f60a998a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930a0992-2b90-4886-8f41-bb35f60a998a', 'volume_size': 1} Jul 10 07:51:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:10 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-916340932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c3c08f-40c0-4be1-8dc5-42a124d82724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:09Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Creating volume 26c3c08f-40c0-4be1-8dc5-42a124d82724 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb50817-86c9-4757-b894-0321ea9d4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da53fdc-c095-44f9-85e4-f68128cb302b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49e8732-60c4-4466-a5ae-d3b15ad220c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:10 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 1073741824 Jul 10 07:51:10 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Volume volume-4da53fdc-c095-44f9-85e4-f68128cb302b (4da53fdc-c095-44f9-85e4-f68128cb302b): created successfully Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49e8732-60c4-4466-a5ae-d3b15ad220c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (4432e26e-d04f-4765-9665-cfda3e2024a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7f8d8cb0-8aba-4ca0-9624-dcb9683a3112 tempest-VolumesListTestJSON-1554072815 None] Created volume successfully. Jul 10 07:51:11 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 1073741824" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:11 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 Jul 10 07:51:11 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:11 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (f00f1521-cf50-449c-9e7e-a849558a2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3ec593-26fc-4290-9a55-e4ca81c7787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.133s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1566468739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930a0992-2b90-4886-8f41-bb35f60a998a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8266b94b3500416da025190e59bc84e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:10Z,use_quota=True,user_id='275d321211aa4793bc7a32a6f9dfd3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Creating volume 930a0992-2b90-4886-8f41-bb35f60a998a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3ec593-26fc-4290-9a55-e4ca81c7787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-762013166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03568a53-d5f9-4bb0-9a9f-a30fb277201c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:12Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb37570-596a-4fe7-bad2-c1b59a04db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a 1073741824 Jul 10 07:51:11 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb37570-596a-4fe7-bad2-c1b59a04db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67a2b26-2d50-4212-90a3-edc9c6f0d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67a2b26-2d50-4212-90a3-edc9c6f0d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03568a53-d5f9-4bb0-9a9f-a30fb277201c', 'volume_name': 'volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b194f-4f7e-47f0-b3b4-9250afea1ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b194f-4f7e-47f0-b3b4-9250afea1ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55abb20c-2939-4891-b718-8ace8c18e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Volume 03568a53-d5f9-4bb0-9a9f-a30fb277201c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c', 'volume_size': 1} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140e6b1-a3a0-45c0-b36f-c209a9058ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c3c08f-40c0-4be1-8dc5-42a124d82724', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b217a016-c987-4d50-b5fc-873f00d11458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Volume volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 (26c3c08f-40c0-4be1-8dc5-42a124d82724): created successfully Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b217a016-c987-4d50-b5fc-873f00d11458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (9c50cb4e-f1af-446e-99cf-f08c2433c841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0349c2f2-7b22-4673-aa59-01336167b587 tempest-AttachVolumeTestJSON-416015785 None] Created volume successfully. Jul 10 07:51:12 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a 1073741824" returned: 0 in 0.839s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:12 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a Jul 10 07:51:12 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:13 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-762013166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03568a53-d5f9-4bb0-9a9f-a30fb277201c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e27fcdc65b4d4c75ac4ec1ba47cdef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:12Z,use_quota=True,user_id='0e2b17d88a6c4bd0a67a48c844391126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Creating volume 03568a53-d5f9-4bb0-9a9f-a30fb277201c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1f0032-0447-4ab0-a918-d2dc7b079830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930a0992-2b90-4886-8f41-bb35f60a998a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:13 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c 1073741824 Jul 10 07:51:13 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd84a6d-7351-4958-b455-50d7bfc54b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Volume volume-930a0992-2b90-4886-8f41-bb35f60a998a (930a0992-2b90-4886-8f41-bb35f60a998a): created successfully Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd84a6d-7351-4958-b455-50d7bfc54b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Flow 'volume_create_manager' (2280efbe-17b9-4089-b107-0b1a212ba21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-80ef07de-d3ca-4ab8-a266-e2277449a442 tempest-VolumesTestJSON-1878753361 None] Created volume successfully. Jul 10 07:51:14 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c 1073741824" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:14 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c Jul 10 07:51:14 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-930a0992-2b90-4886-8f41-bb35f60a998a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "cinder-930a0992-2b90-4886-8f41-bb35f60a998a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-quobyte-930a0992-2b90-4886-8f41-bb35f60a998a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-930a0992-2b90-4886-8f41-bb35f60a998a" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2db7a-928f-4057-938f-ac65bbf50ae9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:15 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c" returned: 0 in 0.711s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55abb20c-2939-4891-b718-8ace8c18e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1926393c-f511-46a9-a348-0151d93bc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:15 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a Jul 10 07:51:15 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Volume volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c (03568a53-d5f9-4bb0-9a9f-a30fb277201c): created successfully Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1926393c-f511-46a9-a348-0151d93bc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Flow 'volume_create_manager' (f00f1521-cf50-449c-9e7e-a849558a2d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2d039bea-1435-46b7-a5d0-610dd3a48a0e tempest-VolumesListTestJSON-1554072815 None] Created volume successfully. Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5048a-3c8e-4ae3-a728-86e19f037935]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:15 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:15 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:15 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:15 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a Jul 10 07:51:15 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:16 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.896s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[415dcd46-4153-43fa-a03d-e14749b0179b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:16 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:16 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:16 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-930a0992-2b90-4886-8f41-bb35f60a998a" returned: 0 in 0.699s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-930a0992-2b90-4886-8f41-bb35f60a998a" released by "delete_volume" :: held 1.587s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Created reservations ['a0c4be7b-69d5-4391-b28d-1e4102c2f2c4', '5d4c6b37-21e8-447b-a718-1e79aabd2d9f', 'f096783c-788b-4bf7-bd47-760b291812b3', 'b4aa935d-408a-4e1e-a91e-13b571624818'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:16 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:16 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:17 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.818s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.09cb5430-bcc2-4da2-a9bc-f58ab6e4da22gvyyt6zp.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:17 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.09cb5430-bcc2-4da2-a9bc-f58ab6e4da22gvyyt6zp.img Jul 10 07:51:17 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-6a9786c0-b40d-4c9d-8f5c-71a14399e012-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-6a9786c0-b40d-4c9d-8f5c-71a14399e012-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-quobyte-6a9786c0-b40d-4c9d-8f5c-71a14399e012" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-6a9786c0-b40d-4c9d-8f5c-71a14399e012" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c16d8-fa6a-4205-8245-5e73af574a74]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:17 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Deleted volume successfully. Jul 10 07:51:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72500861-f034-4264-8d98-d245c5ae507a tempest-VolumesTestJSON-1878753361 None] Lock "cinder-930a0992-2b90-4886-8f41-bb35f60a998a-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:17 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 Jul 10 07:51:17 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-03568a53-d5f9-4bb0-9a9f-a30fb277201c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:19 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012" returned: 0 in 1.715s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-03568a53-d5f9-4bb0-9a9f-a30fb277201c-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:19 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012 Jul 10 07:51:19 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-quobyte-03568a53-d5f9-4bb0-9a9f-a30fb277201c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-03568a53-d5f9-4bb0-9a9f-a30fb277201c" acquired by "delete_volume" :: waited 0.053s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542399a-07c3-4f7f-ab63-972c216c799a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:19 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c Jul 10 07:51:19 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:20 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6a9786c0-b40d-4c9d-8f5c-71a14399e012" returned: 0 in 1.740s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-6a9786c0-b40d-4c9d-8f5c-71a14399e012" released by "delete_volume" :: held 3.544s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Created reservations ['c5566eee-79b6-4d0e-b23c-a8a1b59ee060', '0494dffc-17cf-453f-bd02-4e06ff8280d7', 'f0f6cc8f-908e-4019-abcc-22cd113e95e8', 'ab7772f4-e831-4d6f-88c3-7ad7f3e2bb20'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:21 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c" returned: 0 in 1.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:21 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c Jul 10 07:51:21 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:21 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:21 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-2de81a7f-a2c8-4149-be64-052f7a67a899-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-2de81a7f-a2c8-4149-be64-052f7a67a899-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "cinder-quobyte-2de81a7f-a2c8-4149-be64-052f7a67a899" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-2de81a7f-a2c8-4149-be64-052f7a67a899" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0d6a3-26ee-46b9-b494-b1d0fec1f3bc]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:22 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 Jul 10 07:51:22 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:22 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:22 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Deleted volume successfully. Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-03568a53-d5f9-4bb0-9a9f-a30fb277201c" returned: 0 in 1.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-03568a53-d5f9-4bb0-9a9f-a30fb277201c" released by "delete_volume" :: held 3.538s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08376446-38f9-407f-b8b3-3b9dacb1d109 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-6a9786c0-b40d-4c9d-8f5c-71a14399e012-delete_volume" released by "delete_volume" :: held 5.644s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:22 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.09cb5430-bcc2-4da2-a9bc-f58ab6e4da22gvyyt6zp.img" returned: 0 in 5.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[24785714-2283-4d27-8352-91e973cb443c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Created reservations ['95771238-a452-45ab-b5d3-fa61188c2016', '87cac227-9661-4926-bd85-940a4509483f', 'b0efecc6-17d8-4021-b830-5fd3189be31f', '7e66a4c1-962c-40bf-ba0b-445b858efae7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:23 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:23 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:23 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:23 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:23 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899" returned: 0 in 1.036s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:23 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899 Jul 10 07:51:23 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:23 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Deleted volume successfully. Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c728548-0f39-4c30-954f-5f4195bf11fe tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-03568a53-d5f9-4bb0-9a9f-a30fb277201c-delete_volume" released by "delete_volume" :: held 4.606s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-4da53fdc-c095-44f9-85e4-f68128cb302b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-4da53fdc-c095-44f9-85e4-f68128cb302b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-quobyte-4da53fdc-c095-44f9-85e4-f68128cb302b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-4da53fdc-c095-44f9-85e4-f68128cb302b" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[902fc998-6710-4aa0-82b6-e1d90de291f2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:24 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 1.081s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.09cb5430-bcc2-4da2-a9bc-f58ab6e4da22gvyyt6zp.img {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:51:24 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Converted 1024.00 MB image at 174.37 MB/s Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] 09cb5430-bcc2-4da2-a9bc-f58ab6e4da22 was raw, no need to convert to raw {{(pid=87192) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 07:51:24 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b Jul 10 07:51:24 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:24 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2de81a7f-a2c8-4149-be64-052f7a67a899" returned: 0 in 0.715s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-quobyte-2de81a7f-a2c8-4149-be64-052f7a67a899" released by "delete_volume" :: held 1.886s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Created reservations ['0f0e4e9c-f284-402d-a442-71a3b971e073', '793f1dad-83e0-4a95-bc5a-3ff4caa65db8', '25f0dbef-1e19-4637-9c57-7078278ddfb3', '64be57b1-c70e-49fc-8540-0d97cdb5ac2b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:24 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:24 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:24 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:24 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b Jul 10 07:51:24 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:25 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Deleted volume successfully. Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8366fc65-1938-4e0f-aa37-84fd8a1e6038 tempest-VolumesTestJSON-1878753361 None] Lock "cinder-2de81a7f-a2c8-4149-be64-052f7a67a899-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:25 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4da53fdc-c095-44f9-85e4-f68128cb302b" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-4da53fdc-c095-44f9-85e4-f68128cb302b" released by "delete_volume" :: held 1.709s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Created reservations ['93bf6532-016a-42f5-bf90-02556584b61f', '13bde3a7-16f3-4749-be27-264e753ca6ab', '980a9dd0-777a-4ead-8f89-f9a7b45e5709', '2c229c77-48f4-450d-95ee-ac512d1f51e9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:25 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:25 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-5054df34-e646-439e-9bf2-7870dd8a1c1e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-5054df34-e646-439e-9bf2-7870dd8a1c1e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "cinder-quobyte-5054df34-e646-439e-9bf2-7870dd8a1c1e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-5054df34-e646-439e-9bf2-7870dd8a1c1e" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea4414-95f8-4bdb-b1b7-4c4a4e24ea97]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:26 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e Jul 10 07:51:26 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:26 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.941s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Deleted volume successfully. Jul 10 07:51:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-33b97df5-b57f-4df6-9037-9e6be0b406d9 tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-4da53fdc-c095-44f9-85e4-f68128cb302b-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:27 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e" returned: 0 in 0.882s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:27 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e Jul 10 07:51:27 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:28 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5054df34-e646-439e-9bf2-7870dd8a1c1e" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-quobyte-5054df34-e646-439e-9bf2-7870dd8a1c1e" released by "delete_volume" :: held 1.716s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Created reservations ['2683ae0f-0ae3-4b20-8ed1-18e72c491601', '3f5194b6-0d1d-47cf-b146-dfb96fed5873', 'f117f541-b4f9-4159-9720-0aca63e34056', '26d807ae-44eb-4151-a0a5-ada39c21e9dd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:28 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:28 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:29 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Deleted volume successfully. Jul 10 07:51:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2c1c7acd-7f33-404b-84fa-d40a51bba4bb tempest-VolumesListTestJSON-1554072815 None] Lock "cinder-5054df34-e646-439e-9bf2-7870dd8a1c1e-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3e085452-ab92-4cc1-a9bf-c1204427e05e tempest-BackendsCapabilitiesAdminTestsJSON-2088846426 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 07:51:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9baa77b0-ad4e-49d7-a81e-d52c16b2becc tempest-BackendsCapabilitiesAdminTestsJSON-2088846426 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Flow 'volume_create_manager' (39106fa6-7e2d-4003-8140-f5cb55a76358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b24e3be-689e-4f7b-bf5c-2e89732a8d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b24e3be-689e-4f7b-bf5c-2e89732a8d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-482663324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a4533-6875-44fa-b480-d68e4c7da149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6477f2ded440849e011d515ab37f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:33Z,use_quota=True,user_id='bdb2ef54df0d45ae9babb5cf783a3c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d482b5d-70c9-46d3-9edb-23f6aba6e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d482b5d-70c9-46d3-9edb-23f6aba6e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07949321-3d22-4e11-9fa9-49e36cfc7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07949321-3d22-4e11-9fa9-49e36cfc7b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5a4533-6875-44fa-b480-d68e4c7da149', 'volume_name': 'volume-de5a4533-6875-44fa-b480-d68e4c7da149', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dd3d4e-b2fd-41db-9722-cc5140da29b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dd3d4e-b2fd-41db-9722-cc5140da29b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e8990-100c-47b3-91e4-d69b536475c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Volume de5a4533-6875-44fa-b480-d68e4c7da149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5a4533-6875-44fa-b480-d68e4c7da149', 'volume_size': 1} Jul 10 07:51:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:36 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:36 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:INSERT=33,cinder:SELECT=89,cinder:UPDATE=122,cinder:DELETE=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:51:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-28ef9b3c-d0f3-4ce7-9f33-9eb8c71922a0 tempest-GroupsTest-2080601309 None] Group tempest-Group1-222726331: creating Jul 10 07:51:36 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=111,cinder:UPDATE=146,cinder:DELETE=10,cinder:INSERT=31 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:51:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-28ef9b3c-d0f3-4ce7-9f33-9eb8c71922a0 tempest-GroupsTest-2080601309 None] Group tempest-Group1-222726331: created successfully Jul 10 07:51:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-28ef9b3c-d0f3-4ce7-9f33-9eb8c71922a0 tempest-GroupsTest-2080601309 None] Create group completed successfully. Jul 10 07:51:37 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:51:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:51:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:51:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a5836e22-56dd-4388-ba7e-9715af6c38b4 tempest-GroupsTest-2080601309 None] Group tempest-Group2-727821195: creating Jul 10 07:51:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a5836e22-56dd-4388-ba7e-9715af6c38b4 tempest-GroupsTest-2080601309 None] Group tempest-Group2-727821195: created successfully Jul 10 07:51:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a5836e22-56dd-4388-ba7e-9715af6c38b4 tempest-GroupsTest-2080601309 None] Create group completed successfully. Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (3f49cff0-1a5e-4982-9d03-e4e0285ff344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bbe4d7-7190-44c0-8837-51e50e4d91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bbe4d7-7190-44c0-8837-51e50e4d91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656448135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b28dbc2-1f12-430e-a04c-71414ca6e572,host='devstack@QuobyteHD#QuobyteHD',id=bfe43bc9-44ba-4dc3-af1b-33f4b7452c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:39Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3fa738-8dd5-4977-9a53-f3d90f4e308d),volume_type_id=9e3fa738-8dd5-4977-9a53-f3d90f4e308d)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0211f9-8685-4c8b-8b23-21270d1d1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0211f9-8685-4c8b-8b23-21270d1d1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a0254a-1930-4d16-958b-7978dfc164df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a0254a-1930-4d16-958b-7978dfc164df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe43bc9-44ba-4dc3-af1b-33f4b7452c88', 'volume_name': 'volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d25ed3-8ba5-467b-8077-7105c9cd3d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d25ed3-8ba5-467b-8077-7105c9cd3d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539c3711-cd2f-484f-a897-7ee10573fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Volume bfe43bc9-44ba-4dc3-af1b-33f4b7452c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88', 'volume_size': 1} Jul 10 07:51:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.388s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Uploaded volume to glance image-id: 09cb5430-bcc2-4da2-a9bc-f58ab6e4da22. {{(pid=87192) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 07:51:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.454s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c258a15-e600-4ff5-8364-5b45a699b134]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5e04f258-0c38-423f-9716-c8808712c256 tempest-VolumesActionsTest-1182214777 None] Copy volume to image completed successfully. Jul 10 07:51:45 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 Jul 10 07:51:45 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:46 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724" returned: 0 in 0.762s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.435s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-482663324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a4533-6875-44fa-b480-d68e4c7da149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6477f2ded440849e011d515ab37f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:33Z,use_quota=True,user_id='bdb2ef54df0d45ae9babb5cf783a3c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Creating volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:46 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 1073741824 Jul 10 07:51:46 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-26c3c08f-40c0-4be1-8dc5-42a124d82724', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '181473eb-f007-4105-ba64-7b2cedad9f29', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:51:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-6875e245-963f-433d-b963-99dfa3e20f94 req-d3859632-c134-45f0-aefe-3c094e23a348 tempest-AttachVolumeTestJSON-416015785 None] attachment_update completed successfully. Jul 10 07:51:47 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 1073741824" returned: 0 in 0.949s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:47 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 Jul 10 07:51:47 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:48 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149" returned: 0 in 0.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.585s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b28dbc2-1f12-430e-a04c-71414ca6e572,created_at=2026-07-10T05:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656448135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b28dbc2-1f12-430e-a04c-71414ca6e572,host='devstack@QuobyteHD#QuobyteHD',id=bfe43bc9-44ba-4dc3-af1b-33f4b7452c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:39Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3fa738-8dd5-4977-9a53-f3d90f4e308d),volume_type_id=9e3fa738-8dd5-4977-9a53-f3d90f4e308d)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Creating volume bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:51:48 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:48 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 1073741824 Jul 10 07:51:48 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e8990-100c-47b3-91e4-d69b536475c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5a4533-6875-44fa-b480-d68e4c7da149', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6077089-e4b6-4cc6-822e-fb646a10ff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Volume volume-de5a4533-6875-44fa-b480-d68e4c7da149 (de5a4533-6875-44fa-b480-d68e4c7da149): created successfully Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6077089-e4b6-4cc6-822e-fb646a10ff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Flow 'volume_create_manager' (39106fa6-7e2d-4003-8140-f5cb55a76358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-82f72ac9-1d72-42de-9b0f-50c34d5aa7f9 tempest-VolumesSnapshotListTestJSON-1407110074 None] Created volume successfully. Jul 10 07:51:49 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 1073741824" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:49 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 Jul 10 07:51:49 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:49 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539c3711-cd2f-484f-a897-7ee10573fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2990d33-99ce-4f34-b1b1-efe702a92dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f6e086-44d4-4ff5-9fa0-14ec2ee37f54]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Volume volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 (bfe43bc9-44ba-4dc3-af1b-33f4b7452c88): created successfully Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2990d33-99ce-4f34-b1b1-efe702a92dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (3f49cff0-1a5e-4982-9d03-e4e0285ff344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8666eb3c-4dd9-4124-9157-b0a49aa6c095 tempest-GroupsTest-2080601309 None] Created volume successfully. Jul 10 07:51:49 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:49 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:50 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Acquiring lock "cinder-quobyte-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74c45de-d355-4e1f-a1a6-3b7882036395]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b05218-fba6-4719-810d-b4d7fbf596f2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:50 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:50 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:50 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 Jul 10 07:51:50 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:51 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:51 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img Jul 10 07:51:51 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:51 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" returned: 0 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:51 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88 Jul 10 07:51:51 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:52 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" returned: 0 in 0.937s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-bfe43bc9-44ba-4dc3-af1b-33f4b7452c88" released by "delete_volume" :: held 1.897s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:51:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Created reservations ['4fd1b180-0b86-4039-b9b8-4747e873c9ca'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:52 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-957903811 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-957903811, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:51:52 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-957903811 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-957903811, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:51:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Created reservations ['6aa1f8e8-d957-45e7-8fdf-8a89b9f3c9fc', 'ce99d2dc-0e29-4cb1-b3b2-0b351de20b1b', 'e76e65a6-8869-42af-afe8-69c0146897d1', '01c8b876-6775-4cfd-8540-1f4668012a04'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:53 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:53 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:54 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.555s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d1caec7e-0947-416a-b5b3-a42360a4f835 tempest-GroupsTest-2080601309 None] Delete group completed successfully. Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Created reservations ['7b68cae9-5fdc-4a4f-a134-08df3cf9d128'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:51:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:54 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:51:54 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:56 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.313s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:51:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1d5a95f0-06a3-474d-86bf-d985f292f36c tempest-GroupsTest-2080601309 None] Delete group completed successfully. Jul 10 07:51:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-69fcec28-a408-421c-83fc-4f3e673d306d tempest-GroupsTest-2080601309 None] Group tempest-GroupsTest-Group-1171795604: creating Jul 10 07:51:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-69fcec28-a408-421c-83fc-4f3e673d306d tempest-GroupsTest-2080601309 None] Group tempest-GroupsTest-Group-1171795604: created successfully Jul 10 07:51:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-69fcec28-a408-421c-83fc-4f3e673d306d tempest-GroupsTest-2080601309 None] Create group completed successfully. Jul 10 07:51:57 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img" returned: 0 in 6.165s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd98d954-7996-4b26-a4ef-980156e925cf]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:57 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:51:57 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:58 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.975s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:51:58 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Converted 1024.00 MB image at 166.06 MB/s Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] c4dec7ea-bced-4ce1-8ce1-c77beffd4889 was raw, converting to qcow2 {{(pid=87192) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db8066-705b-4120-964e-611206b138ec]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:58 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img Jul 10 07:51:58 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (1b3f4e37-460f-4ecc-8097-6fe889d13e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea945d50-bead-4011-b0b7-ed92473c6e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea945d50-bead-4011-b0b7-ed92473c6e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095238869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,host='devstack@QuobyteHD#QuobyteHD',id=6dbd22fc-38ff-4f2f-85a4-574c617fdddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:59Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152416ac-8b05-45c5-ae80-babd559107ba),volume_type_id=152416ac-8b05-45c5-ae80-babd559107ba)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e8fd9-2ca8-4e55-90a6-83d998779343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87e8fd9-2ca8-4e55-90a6-83d998779343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fbc4e9-c300-41aa-abb8-70e7b77d6194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fbc4e9-c300-41aa-abb8-70e7b77d6194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbd22fc-38ff-4f2f-85a4-574c617fdddc', 'volume_name': 'volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586ec0cd-6c08-4234-8821-c8b418720a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586ec0cd-6c08-4234-8821-c8b418720a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb65f4e9-3a86-47d4-9514-11ef4086499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:51:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Volume 6dbd22fc-38ff-4f2f-85a4-574c617fdddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc', 'volume_size': 1} Jul 10 07:51:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:51:59 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 10 07:51:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:51:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:51:59 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img Jul 10 07:51:59 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:00 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img" returned: 1 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:52:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:00 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6 Jul 10 07:52:00 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:01 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:01 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Image conversion details: src /opt/stack/data/cinder/conversion/51bdc450-399e-44f8-8630-7ad191357706.temp_image.c4dec7ea-bced-4ce1-8ce1-c77beffd4889lc_6ihkg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:52:01 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 07:52:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e049a2-a39d-43e1-a5ec-cf0b9fe54a90]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:01 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6 Jul 10 07:52:01 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:01 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1glt8ko6" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.469s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Uploaded volume to glance image-id: c4dec7ea-bced-4ce1-8ce1-c77beffd4889. {{(pid=87192) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.978s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Creating offline snapshot 28f3944a-d75a-4cc4-8251-a8ba657da2ec of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8462a2fd-3149-4977-9170-633afcd3752c tempest-VolumesActionsTest-1182214777 None] Copy volume to image completed successfully. Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[868fbfbb-5dc0-4774-a88e-39dce25261fb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:03 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 Jul 10 07:52:03 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:04 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:04 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec 1G Jul 10 07:52:04 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "cinder-quobyte-51bdc450-399e-44f8-8630-7ad191357706" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-quobyte-51bdc450-399e-44f8-8630-7ad191357706" acquired by "delete_volume" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e3391-8ce7-4254-b00c-3471754e0049]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:04 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:52:04 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:05 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec 1G" returned: 0 in 1.499s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:05 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:05 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:05 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 1.151s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:05 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706 Jul 10 07:52:05 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:06 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:06 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec is being set with open permissions: ugo+rw Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:06 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:06 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:06 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-51bdc450-399e-44f8-8630-7ad191357706" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-quobyte-51bdc450-399e-44f8-8630-7ad191357706" released by "delete_volume" :: held 2.005s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Created reservations ['cbbb617f-fe65-448d-960c-85238cb6e722', 'a8a3b017-a74e-473a-93c5-9f0f0cf7c6a0', 'dab74f79-f88c-459d-b9de-267eadd4521d', 'e1f690b6-6d71-4d9a-a4d1-3b9b69cd854c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:06 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:06 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:07 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.887s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:07 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info Jul 10 07:52:07 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:07 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Deleted volume successfully. Jul 10 07:52:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d40dc64-5c47-486d-ab18-d844a26f6387 tempest-VolumesActionsTest-1182214777 None] Lock "cinder-51bdc450-399e-44f8-8630-7ad191357706-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:08 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info is being set with open permissions: ugo+rw Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:08 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info Jul 10 07:52:08 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:08 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.info" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.631s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.914s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,created_at=2026-07-10T05:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095238869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,host='devstack@QuobyteHD#QuobyteHD',id=6dbd22fc-38ff-4f2f-85a4-574c617fdddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:51:59Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152416ac-8b05-45c5-ae80-babd559107ba),volume_type_id=152416ac-8b05-45c5-ae80-babd559107ba)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Creating volume 6dbd22fc-38ff-4f2f-85a4-574c617fdddc {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:52:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:52:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:08 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc 1073741824 Jul 10 07:52:08 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d17d2dc5-75cd-4dfe-863d-0871f6918d37 tempest-VolumesSnapshotListTestJSON-1407110074 None] Create snapshot completed successfully Jul 10 07:52:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:09 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc 1073741824" returned: 0 in 1.016s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:09 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc Jul 10 07:52:09 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:10 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" returned: 0 in 0.710s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb65f4e9-3a86-47d4-9514-11ef4086499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f17dd43-ff06-4027-8a69-ba48b531dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Creating offline snapshot c0c76404-888a-499a-84af-1c47d2d2662f of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Volume volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc (6dbd22fc-38ff-4f2f-85a4-574c617fdddc): created successfully Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f17dd43-ff06-4027-8a69-ba48b531dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (1b3f4e37-460f-4ecc-8097-6fe889d13e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab82b8c-7e0f-4baa-a220-881f6eeaeba8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c8cc2360-42b4-489f-b5d4-9b28600701fc tempest-GroupsTest-2080601309 None] Created volume successfully. Jul 10 07:52:10 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:10 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:11 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:11 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f 1G Jul 10 07:52:11 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (f7e07ad2-7a1d-4583-a7e8-efa6f08ed78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac5a3b5-f72c-4127-8a7c-4d13affdabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac5a3b5-f72c-4127-8a7c-4d13affdabd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153677415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,host='devstack@QuobyteHD#QuobyteHD',id=4f626e7d-f092-4fcd-b3d4-a73bb02ac614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:13Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152416ac-8b05-45c5-ae80-babd559107ba),volume_type_id=152416ac-8b05-45c5-ae80-babd559107ba)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b11db37-6b29-474c-9179-4054713f599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b11db37-6b29-474c-9179-4054713f599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3c346b-0bba-43a3-94c7-d8887d61943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3c346b-0bba-43a3-94c7-d8887d61943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f626e7d-f092-4fcd-b3d4-a73bb02ac614', 'volume_name': 'volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdd0ef3-f1ae-45d0-be7b-1c778450f8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdd0ef3-f1ae-45d0-be7b-1c778450f8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e9b434-362e-4728-a291-8b3c83561bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Volume 4f626e7d-f092-4fcd-b3d4-a73bb02ac614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614', 'volume_size': 1} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:13 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f 1G" returned: 0 in 1.376s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:13 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:13 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:13 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f is being set with open permissions: ugo+rw Jul 10 07:52:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:13 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:13 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:14 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 0.699s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,created_at=2026-07-10T05:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153677415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4463edc6-4e77-4562-acf9-164bc7e84ba8,host='devstack@QuobyteHD#QuobyteHD',id=4f626e7d-f092-4fcd-b3d4-a73bb02ac614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8875f335bc4a518b2431678b06c262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:13Z,use_quota=True,user_id='5879b36f14654082814d4d4184eae2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(152416ac-8b05-45c5-ae80-babd559107ba),volume_type_id=152416ac-8b05-45c5-ae80-babd559107ba)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Creating volume 4f626e7d-f092-4fcd-b3d4-a73bb02ac614 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:52:14 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:14 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 1073741824 Jul 10 07:52:14 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3be6df94-be9d-4209-bc92-09899b3ac0c6 tempest-VolumesSnapshotListTestJSON-1407110074 None] Create snapshot completed successfully Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Flow 'volume_create_manager' (1c9a2be2-7d8a-4b80-9487-68f8ce175f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18668c1e-fa4a-4d5d-8b2a-ce4a60a6c8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18668c1e-fa4a-4d5d-8b2a-ce4a60a6c8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-630439149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c863b170d4a3e8409e56efb812756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:15Z,use_quota=True,user_id='b5768214568d484d8217b9be8cfdc3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb68b0-a3f9-48ea-80f6-0b417e80438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb68b0-a3f9-48ea-80f6-0b417e80438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952f6231-f907-4a51-8775-0618adda222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952f6231-f907-4a51-8775-0618adda222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'volume_name': 'volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a72ee82-3552-429c-b3d0-66a080fd39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a72ee82-3552-429c-b3d0-66a080fd39a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342f0c20-ea6a-4253-8264-9f61961adb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Volume 6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'volume_size': 1} Jul 10 07:52:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:15 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 1073741824" returned: 0 in 1.017s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:15 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 Jul 10 07:52:15 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:16 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-630439149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c863b170d4a3e8409e56efb812756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:15Z,use_quota=True,user_id='b5768214568d484d8217b9be8cfdc3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Creating volume 6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:52:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:16 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc 1073741824 Jul 10 07:52:16 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e9b434-362e-4728-a291-8b3c83561bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c4bdc4-ac61-4835-a6e9-139c82139dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Volume volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 (4f626e7d-f092-4fcd-b3d4-a73bb02ac614): created successfully Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c4bdc4-ac61-4835-a6e9-139c82139dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Flow 'volume_create_manager' (f7e07ad2-7a1d-4583-a7e8-efa6f08ed78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-364ed5a2-9b84-43fc-be04-563a9bd9cfdc tempest-GroupsTest-2080601309 None] Created volume successfully. Jul 10 07:52:17 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc 1073741824" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:17 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:17 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ffa216db-da20-4445-8dad-6ed0c8ae1bbd tempest-GroupsTest-2080601309 None] Update group completed successfully. Jul 10 07:52:17 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.775s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342f0c20-ea6a-4253-8264-9f61961adb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73477700-10ce-4765-abce-d8ac202e8db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Creating offline snapshot 2006587d-c4e2-44dd-a5e0-288643398ece of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:17 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Volume volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc (6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc): created successfully Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73477700-10ce-4765-abce-d8ac202e8db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Flow 'volume_create_manager' (1c9a2be2-7d8a-4b80-9487-68f8ce175f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31fdbf-596b-4217-8523-c128dbe7cdc6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-be140118-b68a-462b-9ee4-87dbf5c6bae5 tempest-VolumesCloneTest-846044515 None] Created volume successfully. Jul 10 07:52:18 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:18 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:18 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:18 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece 1G Jul 10 07:52:18 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-29a7a2b2-5db4-402b-845e-b4f75af16cf9 tempest-GroupsTest-2080601309 None] Update group completed successfully. Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Flow 'volume_create_manager' (b3847e41-fe3a-4182-8c64-4db514efb7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb46abe-b096-475b-bae2-075b2d7f4513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb46abe-b096-475b-bae2-075b2d7f4513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1954586390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349cdf98-a82a-4dcc-b933-5bc8ba4e912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34c863b170d4a3e8409e56efb812756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:19Z,use_quota=True,user_id='b5768214568d484d8217b9be8cfdc3ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3ffebb-db03-42d9-aad2-d41a03d9e611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3ffebb-db03-42d9-aad2-d41a03d9e611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac61be7-347c-4b04-84ac-6f9ef3cfcdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac61be7-347c-4b04-84ac-6f9ef3cfcdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '349cdf98-a82a-4dcc-b933-5bc8ba4e912d', 'volume_name': 'volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d', 'volume_size': 2, 'source_volid': '6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed647bd-4d91-4fe6-a068-57165ea40d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed647bd-4d91-4fe6-a068-57165ea40d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1fddbe-c522-4b37-96bf-4ae52363c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Volume 349cdf98-a82a-4dcc-b933-5bc8ba4e912d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d', 'volume_size': 2, 'source_volid': '6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'source_volstatus': 'available'} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:19 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece 1G" returned: 0 in 0.895s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:19 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece Jul 10 07:52:19 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:20 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece is being set with open permissions: ugo+rw Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:20 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece Jul 10 07:52:20 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Acquiring lock "cinder-quobyte-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f42b9f-6d4e-480b-946b-4eefb772be63]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:20 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 Jul 10 07:52:20 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:21 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.209s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.459s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Cloning volume 6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc to volume 349cdf98-a82a-4dcc-b933-5bc8ba4e912d Jul 10 07:52:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-477675b9-0816-43f1-8a6a-072ebf3e8c3c tempest-VolumesSnapshotListTestJSON-1407110074 None] Create snapshot completed successfully Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Creating offline snapshot 92593092-4081-4b2f-a6e3-9bdab1585835 of volume 6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6f125-7c0c-45a0-947f-936510f88f31]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:21 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:21 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:21 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" returned: 0 in 0.826s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:21 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614 Jul 10 07:52:21 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:22 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 0.832s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:22 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 1G Jul 10 07:52:22 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:22 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" returned: 0 in 0.737s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-4f626e7d-f092-4fcd-b3d4-a73bb02ac614" released by "delete_volume" :: held 1.609s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Acquiring lock "cinder-quobyte-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a54c0-98ad-48e0-8320-5c1bc348a41c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-2006587d-c4e2-44dd-a5e0-288643398ece-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:22 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc Jul 10 07:52:22 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-2006587d-c4e2-44dd-a5e0-288643398ece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-2006587d-c4e2-44dd-a5e0-288643398ece" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-2006587d-c4e2-44dd-a5e0-288643398ece" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Deleting offline snapshot 2006587d-c4e2-44dd-a5e0-288643398ece of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] snapshot_file for this snap is: volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[be198077-9bc8-423c-b698-e8a3062e088a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:22 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece Jul 10 07:52:22 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:22 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 1G" returned: 0 in 0.928s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:22 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:22 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:23 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" returned: 0 in 0.891s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:23 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc Jul 10 07:52:23 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:23 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[20068205-4b56-4ef1-8fdc-e4337ed2c302]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:23 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:23 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:23 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:23 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 is being set with open permissions: ugo+rw Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:23 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:23 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:23 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "cinder-quobyte-6dbd22fc-38ff-4f2f-85a4-574c617fdddc" released by "delete_volume" :: held 1.664s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Created reservations ['4292381a-9f1e-459a-8765-a58610fba5f5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:24 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-572366828 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-572366828, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:52:24 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-572366828 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-572366828, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Created reservations ['8c9dd355-5df5-4b76-bc24-b3e5ccce5daf', 'f67de48a-5edc-47e6-bdfe-990370a5cfc3', '8855b0a1-ae62-4226-8858-03f50b0360fd', '501e807e-acef-437e-91d3-468d032ca5ad'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Created reservations ['d6867e2e-432c-4f1e-8612-7ec6b5303545', 'ffa44f10-d4c0-4e14-82f9-ca27172181fb', 'd7472bff-9a9b-4fd2-aad6-7042e9bae80b', '8f9c71e6-30f7-4644-8f66-b9eec044d491'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:24 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 0.934s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:24 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece Jul 10 07:52:24 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:24 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:24 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:24 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:24 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info Jul 10 07:52:24 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:25 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ff804e74-4d93-4355-a791-470751a48aa0 tempest-GroupsTest-2080601309 None] Delete group completed successfully. Jul 10 07:52:25 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:25 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece Jul 10 07:52:25 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:25 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:25 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info is being set with open permissions: ugo+rw Jul 10 07:52:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:25 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info Jul 10 07:52:25 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:26 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.2006587d-c4e2-44dd-a5e0-288643398ece" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-2006587d-c4e2-44dd-a5e0-288643398ece" released by "_delete_snapshot" :: held 3.600s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:26 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" released by "delete_snapshot" :: held 3.634s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.info" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] snapshot: 92593092-4081-4b2f-a6e3-9bdab1585835, volume: 349cdf98-a82a-4dcc-b933-5bc8ba4e912d, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a024d3-2acb-4dc0-975b-0c3c5526a90a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Created reservations ['5c86ae2f-a1d9-4db3-8599-5e7632088305', 'a3111d2e-0e8b-4f79-9fa4-97a798ccc09f', '8b2b38b9-48f9-42ff-9f58-40dfbae6a19c', '698a2d6b-0c62-4b0e-96dd-d9f4bd2e5a16'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Delete snapshot completed successfully. Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f9a9e4d-f42c-4d4f-93ae-865c8e071018 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-2006587d-c4e2-44dd-a5e0-288643398ece-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:26 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:26 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-c0c76404-888a-499a-84af-1c47d2d2662f-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-c0c76404-888a-499a-84af-1c47d2d2662f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-c0c76404-888a-499a-84af-1c47d2d2662f" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-c0c76404-888a-499a-84af-1c47d2d2662f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Deleting offline snapshot c0c76404-888a-499a-84af-1c47d2d2662f of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] snapshot_file for this snap is: volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f58a2f3-2270-439b-8dd9-731842b32768]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:27 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:27 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:27 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f708d-a333-40ca-9fc2-1444bd7d91ed]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:27 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:27 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:27 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 0.932s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2cff5f-db82-4962-a59a-dcc1dc12c524]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:28 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:28 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:28 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 0.999s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:28 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d Jul 10 07:52:28 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:28 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:28 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:28 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ca8289a7-07da-4174-bbee-5f2bf81273f1 req-c20fa5f8-6a96-4a5f-8a98-d0854209d97a tempest-AttachVolumeTestJSON-416015785 None] Terminate volume connection completed successfully. Jul 10 07:52:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ca8289a7-07da-4174-bbee-5f2bf81273f1 req-c20fa5f8-6a96-4a5f-8a98-d0854209d97a tempest-AttachVolumeTestJSON-416015785 None] Deleting attachment 181473eb-f007-4105-ba64-7b2cedad9f29. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:52:30 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 1.395s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:30 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f Jul 10 07:52:30 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:32 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.c0c76404-888a-499a-84af-1c47d2d2662f" returned: 0 in 1.983s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-c0c76404-888a-499a-84af-1c47d2d2662f" released by "_delete_snapshot" :: held 5.374s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" released by "delete_snapshot" :: held 5.410s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Created reservations ['287a74ee-4239-4bf8-9e41-77d2a7448c83', 'b219e373-3b68-4857-a360-694afebae945', '0eff376f-3f92-4a45-9ed1-c0744a303995', '604aa0b6-788f-47fb-aef5-d66ac71276b0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Delete snapshot completed successfully. Jul 10 07:52:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-efa76811-d6f6-4d01-aadf-0237d882f930 tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-c0c76404-888a-499a-84af-1c47d2d2662f-delete_snapshot" released by "delete_snapshot" :: held 5.943s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-28f3944a-d75a-4cc4-8251-a8ba657da2ec-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-28f3944a-d75a-4cc4-8251-a8ba657da2ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-28f3944a-d75a-4cc4-8251-a8ba657da2ec" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-28f3944a-d75a-4cc4-8251-a8ba657da2ec" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Deleting offline snapshot 28f3944a-d75a-4cc4-8251-a8ba657da2ec of volume de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] snapshot_file for this snap is: volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c91d0b-6330-4185-a5f9-0c909a471b25]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:34 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:34 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:34 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" returned: 0 in 6.408s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9509c7-686a-4149-848b-c45865ebf848]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:34 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:34 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Flow 'volume_create_manager' (844f04e1-108f-48f3-8831-3f370b17bf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ec29b5-19c0-45e0-a701-699b1de34f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:34 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 1.298s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de5a4533-6875-44fa-b480-d68e4c7da149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ec29b5-19c0-45e0-a701-699b1de34f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-270733555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a857e0-56c6-4d8e-8c42-a8560f2f8346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ece8f944c6942eaba7c0a74f622d0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:35Z,use_quota=True,user_id='16a4ec62e2784f749e67c0e2db96c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359218cb-da81-40dd-b007-c6dac9c6d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359218cb-da81-40dd-b007-c6dac9c6d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67b3f8-dd84-4a5c-9d4d-39492008e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db67b3f8-dd84-4a5c-9d4d-39492008e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a857e0-56c6-4d8e-8c42-a8560f2f8346', 'volume_name': 'volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69fe18b-366e-4888-a123-cdff0a5272c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69fe18b-366e-4888-a123-cdff0a5272c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb2b19-58da-4a79-9061-00d5c10abb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346', 'volume_size': 1} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5463cd1-db70-478b-9942-5cc894f6feab]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:35 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 Jul 10 07:52:35 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:35 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 1.078s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:52:35 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Converted 1024.00 MB image at 159.78 MB/s Jul 10 07:52:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d is being set with open permissions: ugo+rw Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:35 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d Jul 10 07:52:35 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:35 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:35 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:35 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:36 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" returned: 0 in 0.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" released by "_copy_volume_from_snapshot" :: held 10.183s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:36 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:36 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-quobyte-92593092-4081-4b2f-a6e3-9bdab1585835" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-92593092-4081-4b2f-a6e3-9bdab1585835" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Deleting offline snapshot 92593092-4081-4b2f-a6e3-9bdab1585835 of volume 6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] snapshot_file for this snap is: volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[23424c81-eb38-4d1d-b220-98f0f02fc730]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:36 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:36 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:36 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:36 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec Jul 10 07:52:36 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:37 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:52:37 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:37 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149.28f3944a-d75a-4cc4-8251-a8ba657da2ec" returned: 0 in 0.669s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[64759628-a0b7-4fb4-a058-957bbf5db54c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=74,cinder:UPDATE=81,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=75,cinder:SELECT=85,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-28f3944a-d75a-4cc4-8251-a8ba657da2ec" released by "_delete_snapshot" :: held 3.802s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" released by "delete_snapshot" :: held 3.853s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:37 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:37 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Created reservations ['d7d551b9-0189-4199-91fa-b0cd8ba5c22b', '2b8c8d6d-3750-4931-88c0-4b6297a22162', 'b7e022e6-7564-47ec-8bed-5861d01ce8c5', 'fbf9f266-a281-4581-b6ef-4ebce893c27c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Delete snapshot completed successfully. Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e9dd2d4a-c2a3-4941-81aa-a662d10ec0fa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-28f3944a-d75a-4cc4-8251-a8ba657da2ec-delete_snapshot" released by "delete_snapshot" :: held 4.040s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-de5a4533-6875-44fa-b480-d68e4c7da149-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-de5a4533-6875-44fa-b480-d68e4c7da149-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa4a3e-9df1-4738-8393-f6aeacc16f88]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:38 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 Jul 10 07:52:38 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:38 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:38 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:38 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:38 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:38 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149 Jul 10 07:52:38 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:38 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:39 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835 Jul 10 07:52:39 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:39 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de5a4533-6875-44fa-b480-d68e4c7da149" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-quobyte-de5a4533-6875-44fa-b480-d68e4c7da149" released by "delete_volume" :: held 1.520s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Created reservations ['62a75215-5e6f-4176-8bf9-14806ee038bc', 'bfcc989f-b8dd-4183-935a-7ee9ec9f298f', '6ff94047-290a-4ea6-92c0-c486a2d4ba19', 'eed2447d-da58-40b8-9bef-82c0dea4eb1a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:39 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:39 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:39 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc.92593092-4081-4b2f-a6e3-9bdab1585835" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-92593092-4081-4b2f-a6e3-9bdab1585835" released by "_delete_snapshot" :: held 3.257s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.613s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-270733555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a857e0-56c6-4d8e-8c42-a8560f2f8346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ece8f944c6942eaba7c0a74f622d0d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:35Z,use_quota=True,user_id='16a4ec62e2784f749e67c0e2db96c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Creating volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:52:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1fddbe-c522-4b37-96bf-4ae52363c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d', 'volume_size': 2, 'source_volid': '6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58ce7b7-cb81-4dd2-9b1c-bd68a557e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:39 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 1073741824 Jul 10 07:52:39 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Volume volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d (349cdf98-a82a-4dcc-b933-5bc8ba4e912d): created successfully Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58ce7b7-cb81-4dd2-9b1c-bd68a557e692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Flow 'volume_create_manager' (b3847e41-fe3a-4182-8c64-4db514efb7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-edd426d1-d189-497a-9d9f-66a3639fae77 tempest-VolumesCloneTest-846044515 None] Created volume successfully. Jul 10 07:52:40 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Deleted volume successfully. Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d695535-2282-46a6-9b2e-e5aa1a0b5efa tempest-VolumesSnapshotListTestJSON-1407110074 None] Lock "cinder-de5a4533-6875-44fa-b480-d68e4c7da149-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:40 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-349cdf98-a82a-4dcc-b933-5bc8ba4e912d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 1073741824" returned: 0 in 1.050s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "cinder-349cdf98-a82a-4dcc-b933-5bc8ba4e912d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:40 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:40 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[343252a6-3bdf-4f0e-bff3-8b232cd843d0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:41 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d Jul 10 07:52:41 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:41 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecb2b19-58da-4a79-9061-00d5c10abb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2495c2-3222-41b7-8333-4fd585d4ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Volume volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 (38a857e0-56c6-4d8e-8c42-a8560f2f8346): created successfully Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2495c2-3222-41b7-8333-4fd585d4ccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Flow 'volume_create_manager' (844f04e1-108f-48f3-8831-3f370b17bf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2483ee52-71e1-4329-8b98-a97efdd4e441 tempest-SnapshotsActionsTest-496591736 None] Created volume successfully. Jul 10 07:52:42 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" returned: 0 in 1.173s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:42 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d Jul 10 07:52:42 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Creating offline snapshot a99454dc-ec69-4ccc-a195-56d9c69d2dee of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82481d-d020-4de7-9de2-471e52026d57]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:42 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-349cdf98-a82a-4dcc-b933-5bc8ba4e912d" released by "delete_volume" :: held 2.049s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:43 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 Jul 10 07:52:43 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Created reservations ['e88f7da4-756d-41e2-a6fc-9038ece15bcd', '353781dc-929c-4fe7-abd9-4380e542a297', '152ee26e-ac30-4d0d-994a-45d3b33b1114', '126483dd-9b59-4ed3-9231-ad37e6cdbcb2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:43 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:43 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:43 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346" returned: 0 in 0.953s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:43 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee 1G Jul 10 07:52:43 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:43 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Deleted volume successfully. Jul 10 07:52:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06aeb3e9-b028-4fda-a53a-65a3f66cc38a tempest-VolumesCloneTest-846044515 None] Lock "cinder-349cdf98-a82a-4dcc-b933-5bc8ba4e912d-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "cinder-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Acquiring lock "cinder-quobyte-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cd773d-e3d2-4e2d-a1d3-466109b75cb5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:45 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:45 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:45 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee 1G" returned: 0 in 2.084s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:45 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:52:45 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:46 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 1.486s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:46 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc Jul 10 07:52:46 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:46 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.072s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:47 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee is being set with open permissions: ugo+rw Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:47 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:52:47 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:47 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "cinder-quobyte-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc" released by "delete_volume" :: held 2.735s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Created reservations ['a68f9ee7-7cf4-4945-82d4-9cb4a6b1295b', 'ef20f369-1650-4c43-8036-2500b1e50185', 'f9022216-8240-40a3-b472-85383b8a6caf', '3556f1bc-3ec7-485e-8581-210584dd5866'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:47 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:52:47 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:47 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.994s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:48 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info Jul 10 07:52:48 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:49 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info" returned: 0 in 1.140s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:49 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info is being set with open permissions: ugo+rw Jul 10 07:52:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:49 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.460s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:52:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Deleted volume successfully. Jul 10 07:52:49 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info Jul 10 07:52:49 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9ddbb32d-c669-4817-a71f-73359a85dcb3 tempest-VolumesCloneTest-846044515 None] Lock "cinder-6bfb9e49-ba41-47bb-9f6b-1ccdb40798fc-delete_volume" released by "delete_volume" :: held 4.704s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:52:50 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.info" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.224s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7b571d95-528f-4514-ab9f-ea3cc5fa344f tempest-SnapshotsActionsTest-496591736 None] Create snapshot completed successfully Jul 10 07:52:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Creating offline snapshot 528201f2-053c-45f0-926a-d424fd49aaf9 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:52:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db07b1ec-6e81-48b1-ae69-fc3bbae884ab]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:52 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:52:52 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:52:52 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Flow 'volume_create_manager' (4969c757-8de7-485c-91da-ade369596fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a067c25-6e95-4e00-ac16-9474bb57c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.122s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a067c25-6e95-4e00-ac16-9474bb57c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1736994599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec0aa1-8097-466d-8139-00c888dc97da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aab018d86ac4a638bf996b677d02411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:53Z,use_quota=True,user_id='d5094347fbb14c28b42b6f2639ec0a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47f2d04-d468-4e5f-977f-3f9930e8a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47f2d04-d468-4e5f-977f-3f9930e8a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:53 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 1G Jul 10 07:52:53 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468c3262-a8d4-423d-ac76-5f5b8a4a47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468c3262-a8d4-423d-ac76-5f5b8a4a47a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ec0aa1-8097-466d-8139-00c888dc97da', 'volume_name': 'volume-16ec0aa1-8097-466d-8139-00c888dc97da', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5488fd9c-a07a-4575-8249-c256d88ac8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5488fd9c-a07a-4575-8249-c256d88ac8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d18b23-cb23-4b31-bd10-4ae452f67901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Volume 16ec0aa1-8097-466d-8139-00c888dc97da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ec0aa1-8097-466d-8139-00c888dc97da', 'volume_size': 2} Jul 10 07:52:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:54 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 1G" returned: 0 in 1.072s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:54 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 Jul 10 07:52:54 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:54 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:54 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 is being set with open permissions: ugo+rw Jul 10 07:52:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:54 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 Jul 10 07:52:54 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:55 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.928s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1736994599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec0aa1-8097-466d-8139-00c888dc97da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aab018d86ac4a638bf996b677d02411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:52:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:52:53Z,use_quota=True,user_id='d5094347fbb14c28b42b6f2639ec0a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Creating volume 16ec0aa1-8097-466d-8139-00c888dc97da {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:52:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:52:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da 2147483648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-47c97879-78c4-4129-9fd9-8b14b031a114 tempest-SnapshotsActionsTest-496591736 None] Create snapshot completed successfully Jul 10 07:52:55 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da 2147483648 Jul 10 07:52:55 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-528201f2-053c-45f0-926a-d424fd49aaf9-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-528201f2-053c-45f0-926a-d424fd49aaf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-528201f2-053c-45f0-926a-d424fd49aaf9" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-528201f2-053c-45f0-926a-d424fd49aaf9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Deleting offline snapshot 528201f2-053c-45f0-926a-d424fd49aaf9 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] snapshot_file for this snap is: volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e2190-9efb-42c0-8d11-8a5bc625d5ea]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:56 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 Jul 10 07:52:56 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:57 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da 2147483648" returned: 0 in 1.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:57 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da Jul 10 07:52:57 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:57 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9" returned: 0 in 1.210s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1903b-9b64-4269-a7a5-f6c390d0d3e3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:57 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:52:57 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:58 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] <== create_volume: return (2755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.761s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d18b23-cb23-4b31-bd10-4ae452f67901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ec0aa1-8097-466d-8139-00c888dc97da', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e637b9-823a-4d3b-9a20-729ffa751453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:52:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Volume volume-16ec0aa1-8097-466d-8139-00c888dc97da (16ec0aa1-8097-466d-8139-00c888dc97da): created successfully Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e637b9-823a-4d3b-9a20-729ffa751453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Flow 'volume_create_manager' (4969c757-8de7-485c-91da-ade369596fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:52:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2e159595-3427-4165-9c48-c8b8d2e69eb0 tempest-VolumesCloneNegativeTest-723983259 None] Created volume successfully. Jul 10 07:52:58 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.985s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:52:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:58 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 Jul 10 07:52:58 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Acquiring lock "cinder-16ec0aa1-8097-466d-8139-00c888dc97da-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:59 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9" returned: 0 in 1.082s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "cinder-16ec0aa1-8097-466d-8139-00c888dc97da-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:59 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9 Jul 10 07:52:59 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Acquiring lock "cinder-quobyte-16ec0aa1-8097-466d-8139-00c888dc97da" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "cinder-quobyte-16ec0aa1-8097-466d-8139-00c888dc97da" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e999689-046c-423a-a5e5-a56a4bf4f061]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:52:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:00 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da Jul 10 07:53:00 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:00 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.528201f2-053c-45f0-926a-d424fd49aaf9" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-528201f2-053c-45f0-926a-d424fd49aaf9" released by "_delete_snapshot" :: held 4.148s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_snapshot" :: held 4.187s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Created reservations ['995b83c5-6a1d-4cad-9637-0946bf9462bf', '2783fde6-9822-477c-a263-fbe0e0a18576', '8536aa53-d8e1-4d59-a430-707099628082', 'b74a97e0-bfb7-49d6-bbc0-319422d91452'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Delete snapshot completed successfully. Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7d071566-dc8b-42cd-a5c0-eaaf2caa959c tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-528201f2-053c-45f0-926a-d424fd49aaf9-delete_snapshot" released by "delete_snapshot" :: held 4.396s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:00 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da" returned: 0 in 0.890s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:00 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da Jul 10 07:53:00 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:01 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-16ec0aa1-8097-466d-8139-00c888dc97da" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "cinder-quobyte-16ec0aa1-8097-466d-8139-00c888dc97da" released by "delete_volume" :: held 1.631s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Created reservations ['9d088f2a-71e7-47b6-8f46-59948bc90a19', '0960fc13-a367-4390-b715-b6a77495536b', '7df3280a-ecb0-4929-aaa6-2699a1b54c76', 'dd0abedd-46fc-46de-bd2f-905322e7e814'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:01 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:53:01 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Creating offline snapshot 2065ea3e-7d0e-47d9-97f9-708cb7274845 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd26ae83-e015-4755-bf49-67f28d8e8bd7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:02 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:02 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:02 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.740s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:53:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Deleted volume successfully. Jul 10 07:53:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b46c5be-2720-4eac-ac12-102f621a9f7f tempest-VolumesCloneNegativeTest-723983259 None] Lock "cinder-16ec0aa1-8097-466d-8139-00c888dc97da-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:03 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.890s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:03 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 1G Jul 10 07:53:03 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:04 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 1G" returned: 0 in 1.216s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:04 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 Jul 10 07:53:04 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:05 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845" returned: 0 in 1.157s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:05 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 is being set with open permissions: ugo+rw Jul 10 07:53:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:05 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 Jul 10 07:53:05 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:06 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845" returned: 0 in 0.945s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-223e6da9-3cd4-4952-b161-d24b9e47a7ee tempest-SnapshotsActionsTest-496591736 None] Create snapshot completed successfully Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-2065ea3e-7d0e-47d9-97f9-708cb7274845-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-2065ea3e-7d0e-47d9-97f9-708cb7274845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-2065ea3e-7d0e-47d9-97f9-708cb7274845" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-2065ea3e-7d0e-47d9-97f9-708cb7274845" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Deleting offline snapshot 2065ea3e-7d0e-47d9-97f9-708cb7274845 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] snapshot_file for this snap is: volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347c24d-dea6-403a-8960-4df75f1933ca]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:07 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 Jul 10 07:53:07 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:08 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[968dbfdd-7870-42f9-b632-3fb460d78290]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:08 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:08 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:09 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:09 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 Jul 10 07:53:09 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:10 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845" returned: 0 in 0.990s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:10 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845 Jul 10 07:53:10 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:11 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.2065ea3e-7d0e-47d9-97f9-708cb7274845" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-2065ea3e-7d0e-47d9-97f9-708cb7274845" released by "_delete_snapshot" :: held 3.759s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_snapshot" :: held 3.794s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Created reservations ['b58ecdc4-db1a-4543-96e6-4fd865f81fea', 'b3aec7d4-9108-499a-a98d-08474fedae57', '77012a03-97b7-4156-b689-82473384f51e', '14194ab7-c9af-4b5c-ad16-9c1a6a203176'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Delete snapshot completed successfully. Jul 10 07:53:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97c11bf-d81c-48bd-ab22-e506a530c437 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-2065ea3e-7d0e-47d9-97f9-708cb7274845-delete_snapshot" released by "delete_snapshot" :: held 3.984s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Creating offline snapshot 131c007c-d8dd-4bcb-97f0-55f2f855c662 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:53:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de37a4f-cee2-4763-a02a-d56ce7ca85d6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:12 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:12 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:13 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:13 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 1G Jul 10 07:53:13 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:14 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 1G" returned: 0 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:14 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 Jul 10 07:53:14 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:15 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:15 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 is being set with open permissions: ugo+rw Jul 10 07:53:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:15 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 Jul 10 07:53:15 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:16 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662" returned: 0 in 0.927s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fcc95ca3-5aa6-464c-960d-9342bd52b0fd tempest-SnapshotsActionsTest-496591736 None] Create snapshot completed successfully Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-131c007c-d8dd-4bcb-97f0-55f2f855c662-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-131c007c-d8dd-4bcb-97f0-55f2f855c662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-131c007c-d8dd-4bcb-97f0-55f2f855c662" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-131c007c-d8dd-4bcb-97f0-55f2f855c662" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Deleting offline snapshot 131c007c-d8dd-4bcb-97f0-55f2f855c662 of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] snapshot_file for this snap is: volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b82a05b-9251-4f52-9e76-b3e2fb6b6e11]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:16 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 Jul 10 07:53:16 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:17 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662" returned: 0 in 0.989s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a8bb5-515b-4720-9397-faeac14dadb3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:17 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:17 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:18 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.985s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:18 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 Jul 10 07:53:18 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:20 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662" returned: 0 in 1.179s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:20 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662 Jul 10 07:53:20 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (37c4806c-109e-4e20-8c48-da9e31782b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6601cdd-5a7e-486a-8221-4ee5e254efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6601cdd-5a7e-486a-8221-4ee5e254efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610303475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c289ff-5595-4fb1-8fda-5c664f1826a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:21Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174d7365-f538-4d9e-a0c4-7d10ed33ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174d7365-f538-4d9e-a0c4-7d10ed33ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a590b28-a28e-4485-858d-eec518f27f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a590b28-a28e-4485-858d-eec518f27f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c289ff-5595-4fb1-8fda-5c664f1826a9', 'volume_name': 'volume-43c289ff-5595-4fb1-8fda-5c664f1826a9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6893d-4528-4a15-9f8b-7cb330151962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6893d-4528-4a15-9f8b-7cb330151962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc7ae0-8ca0-49a2-befa-2c8ab6ee4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume 43c289ff-5595-4fb1-8fda-5c664f1826a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c289ff-5595-4fb1-8fda-5c664f1826a9', 'volume_size': 1} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610303475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c289ff-5595-4fb1-8fda-5c664f1826a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:21Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Creating volume 43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:53:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:20 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.131c007c-d8dd-4bcb-97f0-55f2f855c662" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:20 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 1073741824 Jul 10 07:53:20 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-131c007c-d8dd-4bcb-97f0-55f2f855c662" released by "_delete_snapshot" :: held 4.260s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_snapshot" :: held 4.294s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Created reservations ['125e86fc-0427-4cfb-a4e9-7d8a504acfb5', '7f3632bc-ff70-441a-ba81-ba96f2d4dfc4', '85aed4fc-9fa4-4159-b62f-85e08cc51505', '5e0bdffd-edc8-4a2a-a8ea-5538b4d4fbba'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Delete snapshot completed successfully. Jul 10 07:53:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-74db3baf-94ac-4481-9865-45df1ef574b3 tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-131c007c-d8dd-4bcb-97f0-55f2f855c662-delete_snapshot" released by "delete_snapshot" :: held 4.505s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:22 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 1073741824" returned: 0 in 1.153s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:22 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 Jul 10 07:53:22 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:23 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9" returned: 0 in 0.934s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.583s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dc7ae0-8ca0-49a2-befa-2c8ab6ee4c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c289ff-5595-4fb1-8fda-5c664f1826a9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156afa12-529e-4cf5-b1a2-0d6d1610135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Creating offline snapshot d0188374-56b7-4df4-ac3a-3e639d9914bc of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:53:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 (43c289ff-5595-4fb1-8fda-5c664f1826a9): created successfully Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156afa12-529e-4cf5-b1a2-0d6d1610135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (37c4806c-109e-4e20-8c48-da9e31782b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5557ad15-8f75-4678-97e7-02805c7f9ec2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b24fb788-796c-4d15-b03e-818c208d98b8 tempest-VolumesSnapshotTestJSON-42414070 None] Created volume successfully. Jul 10 07:53:23 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:23 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:24 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:24 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc 1G Jul 10 07:53:24 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:25 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc 1G" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:25 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc Jul 10 07:53:25 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:25 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:25 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc is being set with open permissions: ugo+rw Jul 10 07:53:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:25 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc Jul 10 07:53:25 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:26 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.263s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Creating offline snapshot dac2d3e9-f33f-4682-9cba-cd049eb71242 of volume 43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:53:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b28ba3be-e445-4668-92f1-e3c1c07026b4 tempest-SnapshotsActionsTest-496591736 None] Create snapshot completed successfully Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dccb3a5-f04f-443c-8086-ef190e12e587]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:26 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 Jul 10 07:53:26 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-d0188374-56b7-4df4-ac3a-3e639d9914bc-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-d0188374-56b7-4df4-ac3a-3e639d9914bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Acquiring lock "cinder-quobyte-d0188374-56b7-4df4-ac3a-3e639d9914bc" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-d0188374-56b7-4df4-ac3a-3e639d9914bc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Deleting offline snapshot d0188374-56b7-4df4-ac3a-3e639d9914bc of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] snapshot_file for this snap is: volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c87cf3c-a03f-42a5-90de-cf8fa6bfbf8b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:27 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc Jul 10 07:53:27 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:27 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9" returned: 0 in 1.246s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:27 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 1G Jul 10 07:53:27 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:28 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc" returned: 0 in 1.021s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[74537ca0-6e4f-4ed3-813f-316f26eeb8a3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:28 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:28 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:28 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 1G" returned: 0 in 0.981s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:28 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 Jul 10 07:53:28 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:29 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 0.908s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:29 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc Jul 10 07:53:29 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:29 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242" returned: 0 in 1.023s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:29 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 is being set with open permissions: ugo+rw Jul 10 07:53:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:29 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 Jul 10 07:53:29 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:30 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc" returned: 0 in 1.455s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:30 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc Jul 10 07:53:30 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:31 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242" returned: 0 in 1.183s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:31 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info Jul 10 07:53:31 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:31 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.d0188374-56b7-4df4-ac3a-3e639d9914bc" returned: 0 in 1.135s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-d0188374-56b7-4df4-ac3a-3e639d9914bc" released by "_delete_snapshot" :: held 4.702s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_snapshot" :: held 4.752s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:31 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Created reservations ['3175374b-025d-4f9a-bee5-8e94166b1b8a', 'b5072dac-aa8a-45a0-ab79-373243bf3133', 'db9b3073-527d-4de2-8d97-a0ac72219cdb', 'ca7a5c6c-8808-4cf5-8cc0-e8e009d37a27'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Delete snapshot completed successfully. Jul 10 07:53:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c61a645-4367-42f4-b419-8738144efd5b tempest-SnapshotsActionsTest-1669886436 None] Lock "cinder-d0188374-56b7-4df4-ac3a-3e639d9914bc-delete_snapshot" released by "delete_snapshot" :: held 5.182s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:32 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info" returned: 0 in 1.288s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:32 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info is being set with open permissions: ugo+rw Jul 10 07:53:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:32 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info Jul 10 07:53:32 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "cinder-a99454dc-ec69-4ccc-a195-56d9c69d2dee-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-a99454dc-ec69-4ccc-a195-56d9c69d2dee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "cinder-quobyte-a99454dc-ec69-4ccc-a195-56d9c69d2dee" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-a99454dc-ec69-4ccc-a195-56d9c69d2dee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Deleting offline snapshot a99454dc-ec69-4ccc-a195-56d9c69d2dee of volume 38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] snapshot_file for this snap is: volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feda18a-ab22-4942-bdf0-9e4c72eea6a2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:33 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:33 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:33 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.info" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.943s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c9b07efd-1295-4c88-9982-3e2a9bba4d8d tempest-VolumesSnapshotTestJSON-42414070 None] Create snapshot completed successfully Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-dac2d3e9-f33f-4682-9cba-cd049eb71242-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-dac2d3e9-f33f-4682-9cba-cd049eb71242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-dac2d3e9-f33f-4682-9cba-cd049eb71242" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-dac2d3e9-f33f-4682-9cba-cd049eb71242" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Deleting offline snapshot dac2d3e9-f33f-4682-9cba-cd049eb71242 of volume 43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] snapshot_file for this snap is: volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[266cb8b8-d2fb-486a-8071-14511f0003b5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:34 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.292s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:34 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 Jul 10 07:53:34 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[130bd1c5-bd91-4a4e-998b-391219095426]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:34 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 Jul 10 07:53:34 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:35 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242" returned: 0 in 0.924s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43c289ff-5595-4fb1-8fda-5c664f1826a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eded8bb-9139-4a39-9366-4934fb9d0d4e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:35 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 Jul 10 07:53:35 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:35 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:35 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:35 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:36 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:36 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 Jul 10 07:53:36 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:36 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:53:36 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:36 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.130s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:36 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee Jul 10 07:53:36 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:37 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:53:37 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242" returned: 0 in 1.201s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:37 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242 Jul 10 07:53:37 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:37 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346.a99454dc-ec69-4ccc-a195-56d9c69d2dee" returned: 0 in 1.373s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=65,cinder:INSERT=22,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:53:37 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=81,cinder:INSERT=20,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-a99454dc-ec69-4ccc-a195-56d9c69d2dee" released by "_delete_snapshot" :: held 4.904s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_snapshot" :: held 4.938s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Created reservations ['44f9e850-95d5-4981-bbdb-4e6e780678d6', '8665fa5d-b91e-49e9-a360-fce18cabfa6c', 'fcf356b4-fab4-46ae-825c-985bed8d295a', 'd95c7876-8ee7-4715-9412-2190dafb2af1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Delete snapshot completed successfully. Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f6e8ef89-582e-42e2-8150-1d63e283c9d1 tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-a99454dc-ec69-4ccc-a195-56d9c69d2dee-delete_snapshot" released by "delete_snapshot" :: held 5.350s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:38 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9.dac2d3e9-f33f-4682-9cba-cd049eb71242" returned: 0 in 1.095s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "cinder-38a857e0-56c6-4d8e-8c42-a8560f2f8346-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-dac2d3e9-f33f-4682-9cba-cd049eb71242" released by "_delete_snapshot" :: held 4.520s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" released by "delete_snapshot" :: held 4.587s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-38a857e0-56c6-4d8e-8c42-a8560f2f8346-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab094c1-9811-4281-ac6b-cbb26eb16ed7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['10045d29-1f25-427d-9713-92f7175f8d16', '135f09b1-ecb1-47bc-ae5f-c2cac7b8f023', '71cc68a9-1422-4dde-b69e-fb5c95dc4837', 'dc84da80-7df5-44c9-8da5-fd71d94b2342'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Delete snapshot completed successfully. Jul 10 07:53:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e6b9028-b47b-4851-9116-279faac0a420 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-dac2d3e9-f33f-4682-9cba-cd049eb71242-delete_snapshot" released by "delete_snapshot" :: held 4.920s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:39 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 Jul 10 07:53:39 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:40 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346" returned: 0 in 1.135s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:40 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346 Jul 10 07:53:40 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (6b9c971d-58fc-4cf0-8a89-8e656d8b3caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd6f078-d41a-4444-aba8-44f1a562f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd6f078-d41a-4444-aba8-44f1a562f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1280863914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed1250f-3830-46a5-b42a-2875d197c60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:40Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907e3a03-f556-4ef7-8bff-c5e8c3d1585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907e3a03-f556-4ef7-8bff-c5e8c3d1585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e86dd7-e3f3-4c1b-b84c-55551dd24f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e86dd7-e3f3-4c1b-b84c-55551dd24f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed1250f-3830-46a5-b42a-2875d197c60e', 'volume_name': 'volume-8ed1250f-3830-46a5-b42a-2875d197c60e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3c97d9-e9ac-45dc-b79f-909591126a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3c97d9-e9ac-45dc-b79f-909591126a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9a57e2-12ed-4816-b601-c16024b7067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Volume 8ed1250f-3830-46a5-b42a-2875d197c60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed1250f-3830-46a5-b42a-2875d197c60e', 'volume_size': 1} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1280863914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed1250f-3830-46a5-b42a-2875d197c60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:40Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Creating volume 8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:53:40 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:53:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:40 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e 1073741824 Jul 10 07:53:40 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:41 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-38a857e0-56c6-4d8e-8c42-a8560f2f8346" returned: 0 in 1.118s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-quobyte-38a857e0-56c6-4d8e-8c42-a8560f2f8346" released by "delete_volume" :: held 2.376s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Created reservations ['3b6eac2a-3570-44b4-92a0-ea82bb20505b', '4ef21cb1-279e-4c21-b2a6-7921e5633cb0', '830f4c2f-2c26-41cb-8a8d-85aade3f07e7', 'a9ecb0ba-fe0a-475b-a21b-363f92a9ed5a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:41 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:53:41 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:41 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e 1073741824" returned: 0 in 1.405s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:41 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:53:41 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:42 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.081s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:53:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Deleted volume successfully. Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-587ba9a8-f48e-4bda-916b-7acf16838e2a tempest-SnapshotsActionsTest-496591736 None] Lock "cinder-38a857e0-56c6-4d8e-8c42-a8560f2f8346-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:53:42 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 1.024s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9a57e2-12ed-4816-b601-c16024b7067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed1250f-3830-46a5-b42a-2875d197c60e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83812fe5-a2b1-4722-b5a1-c9a83276ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Volume volume-8ed1250f-3830-46a5-b42a-2875d197c60e (8ed1250f-3830-46a5-b42a-2875d197c60e): created successfully Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83812fe5-a2b1-4722-b5a1-c9a83276ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (6b9c971d-58fc-4cf0-8a89-8e656d8b3caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-47eb625b-7989-43b9-83fa-6af481677c0f tempest-VolumesSnapshotTestJSON-42414070 None] Created volume successfully. Jul 10 07:53:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Creating offline snapshot fd5cfbba-2258-4307-aa75-33eb0c5eb214 of volume 8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:53:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a13585-8bd4-4f60-9943-e2e0b97fe04f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:43 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:53:43 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:44 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 1.064s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:44 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 1G Jul 10 07:53:44 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:45 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 1G" returned: 0 in 1.008s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed1250f-3830-46a5-b42a-2875d197c60e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:45 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed1250f-3830-46a5-b42a-2875d197c60e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:53:45 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:46 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed1250f-3830-46a5-b42a-2875d197c60e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:46 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 is being set with open permissions: ugo+rw Jul 10 07:53:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:46 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:53:46 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:47 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:47 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info Jul 10 07:53:47 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:48 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:48 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info is being set with open permissions: ugo+rw Jul 10 07:53:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:48 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info Jul 10 07:53:48 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:49 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.info" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.438s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ed90ec8-8cf7-47c0-8c28-cd3ea8bf44a1 tempest-VolumesSnapshotTestJSON-42414070 None] Create snapshot completed successfully Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (eb3765a0-7402-498b-bd0e-75919edc482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed933d1e-cc17-4f61-9fe1-c44ef6fd061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed933d1e-cc17-4f61-9fe1-c44ef6fd061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272608353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df3c2e8-4996-42b0-aca1-4d1add3a44a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fd5cfbba-2258-4307-aa75-33eb0c5eb214,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:51Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8576c6b7-84c5-4feb-89c5-38ae6028f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8576c6b7-84c5-4feb-89c5-38ae6028f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fe8823-0f6a-42a5-a300-33a0d9cebbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fe8823-0f6a-42a5-a300-33a0d9cebbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3df3c2e8-4996-42b0-aca1-4d1add3a44a5', 'volume_name': 'volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5', 'volume_size': 2, 'snapshot_id': 'fd5cfbba-2258-4307-aa75-33eb0c5eb214'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d94329-2c26-4bc9-9428-6991a9473be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d94329-2c26-4bc9-9428-6991a9473be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2f03a5-7a72-4ce6-a821-a4fd971a9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Volume 3df3c2e8-4996-42b0-aca1-4d1add3a44a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5', 'volume_size': 2, 'snapshot_id': 'fd5cfbba-2258-4307-aa75-33eb0c5eb214'} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Creating volume 3df3c2e8-4996-42b0-aca1-4d1add3a44a5 from snapshot fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:53:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] snapshot: fd5cfbba-2258-4307-aa75-33eb0c5eb214, volume: 3df3c2e8-4996-42b0-aca1-4d1add3a44a5, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f249a-308b-4a67-bf96-568b47da7410]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:51 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:53:51 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:51 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 0.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ed1250f-3830-46a5-b42a-2875d197c60e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:53:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:53:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa78aa7-95cd-466d-9f32-82659aacb927]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:52 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:53:52 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:52 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 0.908s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:52 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:53:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:52 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 Jul 10 07:53:52 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Flow 'volume_create_manager' (a980a39c-71c2-4c75-957a-d161452ffd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f0afc9-4176-43d0-a794-1f11dcda826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f0afc9-4176-43d0-a794-1f11dcda826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1795221224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791815fd-9061-4f26-957e-e40b68388d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0c1fe8901f47b58cb22bcf47bb50c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:57Z,use_quota=True,user_id='98c1c8c881894e188115cacc3f4a7d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96109f3-c532-4da7-8a32-2b2ace703e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96109f3-c532-4da7-8a32-2b2ace703e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fb16af-6738-4443-a395-658b8d24954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fb16af-6738-4443-a395-658b8d24954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791815fd-9061-4f26-957e-e40b68388d33', 'volume_name': 'volume-791815fd-9061-4f26-957e-e40b68388d33', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b466b3a5-f2d7-4bac-a6db-3501fa70d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b466b3a5-f2d7-4bac-a6db-3501fa70d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc14f8d-2da4-4772-9ba6-950dcf14d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Volume 791815fd-9061-4f26-957e-e40b68388d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791815fd-9061-4f26-957e-e40b68388d33', 'volume_size': 1} Jul 10 07:53:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Flow 'volume_create_manager' (bda211cf-e337-4ca0-a3f2-c86e35bc44a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef18978b-090c-480a-9cf1-a67b7e62d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef18978b-090c-480a-9cf1-a67b7e62d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-460148227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45469435-4e36-4d92-8816-b32f2c98d57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a46fa53bb542128e1376efb092b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:59Z,use_quota=True,user_id='43e34a945fd94b6183a621cfd3f6b84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f74fcd9-1ed9-4c41-9fd0-cdd45289459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f74fcd9-1ed9-4c41-9fd0-cdd45289459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4773c76c-ea45-4ce6-8259-0b5868b7a803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4773c76c-ea45-4ce6-8259-0b5868b7a803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45469435-4e36-4d92-8816-b32f2c98d57b', 'volume_name': 'volume-45469435-4e36-4d92-8816-b32f2c98d57b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9950345a-c789-4c97-8c4d-f7d469ab3614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9950345a-c789-4c97-8c4d-f7d469ab3614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf42ece-b024-4357-b2b2-a490813c5335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:53:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Volume 45469435-4e36-4d92-8816-b32f2c98d57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45469435-4e36-4d92-8816-b32f2c98d57b', 'volume_size': 1} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:53:58 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" returned: 0 in 5.981s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ab5e7-659e-4c41-9516-1e6603550b75]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:53:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:59 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:53:59 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:53:59 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 10 07:53:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:53:59 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:53:59 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Converted 1024.00 MB image at 171.17 MB/s Jul 10 07:53:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 is being set with open permissions: ugo+rw Jul 10 07:53:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:53:59 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 Jul 10 07:53:59 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:00 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" released by "_copy_volume_from_snapshot" :: held 9.594s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" released by "_create_volume_from_snapshot" :: held 9.626s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.643s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.188s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1795221224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791815fd-9061-4f26-957e-e40b68388d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0c1fe8901f47b58cb22bcf47bb50c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:57Z,use_quota=True,user_id='98c1c8c881894e188115cacc3f4a7d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Creating volume 791815fd-9061-4f26-957e-e40b68388d33 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:00 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 1073741824 Jul 10 07:54:00 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2f03a5-7a72-4ce6-a821-a4fd971a9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5', 'volume_size': 2, 'snapshot_id': 'fd5cfbba-2258-4307-aa75-33eb0c5eb214'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb137ca-a2ab-4c74-857d-5620f4e2430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Volume volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 (3df3c2e8-4996-42b0-aca1-4d1add3a44a5): created successfully Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb137ca-a2ab-4c74-857d-5620f4e2430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (eb3765a0-7402-498b-bd0e-75919edc482b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-18aea147-1dcb-4d98-8851-f3951c58ba62 tempest-VolumesSnapshotTestJSON-42414070 None] Created volume successfully. Jul 10 07:54:01 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 1073741824" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:01 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 Jul 10 07:54:01 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-3df3c2e8-4996-42b0-aca1-4d1add3a44a5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-3df3c2e8-4996-42b0-aca1-4d1add3a44a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c16d10e-1cc3-4676-b429-cf32361c484b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:02 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:02 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 Jul 10 07:54:02 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-460148227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45469435-4e36-4d92-8816-b32f2c98d57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a46fa53bb542128e1376efb092b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:53:59Z,use_quota=True,user_id='43e34a945fd94b6183a621cfd3f6b84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Creating volume 45469435-4e36-4d92-8816-b32f2c98d57b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc14f8d-2da4-4772-9ba6-950dcf14d51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791815fd-9061-4f26-957e-e40b68388d33', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:02 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b 1073741824 Jul 10 07:54:02 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622ede6-65ee-41a0-a6cb-65720c998826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Volume volume-791815fd-9061-4f26-957e-e40b68388d33 (791815fd-9061-4f26-957e-e40b68388d33): created successfully Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622ede6-65ee-41a0-a6cb-65720c998826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Flow 'volume_create_manager' (a980a39c-71c2-4c75-957a-d161452ffd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ac1a9b82-ae3d-4b0d-a073-cbbe955d8570 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Created volume successfully. Jul 10 07:54:02 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:02 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5 Jul 10 07:54:02 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:03 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b 1073741824" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:03 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b Jul 10 07:54:03 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:03 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3df3c2e8-4996-42b0-aca1-4d1add3a44a5" released by "delete_volume" :: held 1.517s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['f85244f3-fbbd-46dd-968e-6a27919b07ab', 'd6f7a211-4945-48c9-a341-27c008106a05', '810bd5af-e6b9-46af-84ec-3a3b1e84cd85', 'bd3cccf5-0ee1-4cd4-be57-710010fa7101'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:03 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:03 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:03 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf42ece-b024-4357-b2b2-a490813c5335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45469435-4e36-4d92-8816-b32f2c98d57b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c1ea4a-c8a5-4141-8bcd-6f956da89ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Volume volume-45469435-4e36-4d92-8816-b32f2c98d57b (45469435-4e36-4d92-8816-b32f2c98d57b): created successfully Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c1ea4a-c8a5-4141-8bcd-6f956da89ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Flow 'volume_create_manager' (bda211cf-e337-4ca0-a3f2-c86e35bc44a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1aea27e6-c6b7-4baf-8206-c0aaf1b070bc tempest-VolumesServicesTestJSON-413901152 None] Created volume successfully. Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-fd5cfbba-2258-4307-aa75-33eb0c5eb214-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-fd5cfbba-2258-4307-aa75-33eb0c5eb214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Deleting offline snapshot fd5cfbba-2258-4307-aa75-33eb0c5eb214 of volume 8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:54:04 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] snapshot_file for this snap is: volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Deleted volume successfully. Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2f98f-9bf0-4d2e-b590-f4b5b0f11a0a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e641da38-1311-4302-b929-30e944f4ed12 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-3df3c2e8-4996-42b0-aca1-4d1add3a44a5-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:04 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:54:04 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:05 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 0.783s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ed1250f-3830-46a5-b42a-2875d197c60e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c9e45-43ce-4f3f-81ea-697511cef42d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Acquiring lock "cinder-45469435-4e36-4d92-8816-b32f2c98d57b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "cinder-45469435-4e36-4d92-8816-b32f2c98d57b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:05 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:54:05 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Acquiring lock "cinder-quobyte-45469435-4e36-4d92-8816-b32f2c98d57b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "cinder-quobyte-45469435-4e36-4d92-8816-b32f2c98d57b" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d248de7d-19c1-457a-8aa9-fff5f46bcbaa]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:05 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b Jul 10 07:54:05 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (2f7378ea-dd50-408b-a275-dbe357ede63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c8920-ee52-48b5-bedc-37e04de1947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c8920-ee52-48b5-bedc-37e04de1947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095540892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768aee09-b961-4e01-889c-f8b10ee2b476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:05Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e4849b-507b-4b40-b3a6-39cf09efe9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e4849b-507b-4b40-b3a6-39cf09efe9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a6fb3f-ee47-48a9-8473-b77e238aaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a6fb3f-ee47-48a9-8473-b77e238aaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768aee09-b961-4e01-889c-f8b10ee2b476', 'volume_name': 'volume-768aee09-b961-4e01-889c-f8b10ee2b476', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fba00e-18c1-4901-a12f-f2114c3e3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fba00e-18c1-4901-a12f-f2114c3e3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd3f58-5bc0-407c-888a-85fd47c38c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Volume 768aee09-b961-4e01-889c-f8b10ee2b476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768aee09-b961-4e01-889c-f8b10ee2b476', 'volume_size': 1} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095540892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768aee09-b961-4e01-889c-f8b10ee2b476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:05Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Creating volume 768aee09-b961-4e01-889c-f8b10ee2b476 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:05 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:05 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 1073741824 Jul 10 07:54:05 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:06 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 0.891s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:06 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:54:06 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:06 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:06 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b Jul 10 07:54:06 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:06 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 1073741824" returned: 0 in 1.029s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:06 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 Jul 10 07:54:06 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:06 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 0.900s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:06 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214 Jul 10 07:54:06 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:06 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45469435-4e36-4d92-8816-b32f2c98d57b" returned: 0 in 0.781s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "cinder-quobyte-45469435-4e36-4d92-8816-b32f2c98d57b" released by "delete_volume" :: held 1.698s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Created reservations ['693858eb-e6ae-4810-b147-a1f0f2a4144f', '3bc708b4-4aa2-4ac1-b347-6bb77a487a41', 'dae66167-7b6f-4760-b61d-0c5f6f21773c', 'f043ae75-70ff-4b97-957c-9eac711cb4a8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:07 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:07 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:07 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.824s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd3f58-5bc0-407c-888a-85fd47c38c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768aee09-b961-4e01-889c-f8b10ee2b476', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395ad52a-7ddb-47a2-ab80-da11f0f2d291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f3ae0d-6d96-4be0-9eae-6db7ef6cf64e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Volume volume-768aee09-b961-4e01-889c-f8b10ee2b476 (768aee09-b961-4e01-889c-f8b10ee2b476): created successfully Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395ad52a-7ddb-47a2-ab80-da11f0f2d291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (2f7378ea-dd50-408b-a275-dbe357ede63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9f3b1103-8b57-45ed-969e-0d6384e8fd46 tempest-AttachVolumeTestJSON-416015785 None] Created volume successfully. Jul 10 07:54:07 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 Jul 10 07:54:07 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:07 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e.fd5cfbba-2258-4307-aa75-33eb0c5eb214" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-fd5cfbba-2258-4307-aa75-33eb0c5eb214" released by "_delete_snapshot" :: held 3.499s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" released by "delete_snapshot" :: held 3.527s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['08b5832b-6673-4f13-8dee-eea5fc8dfc7e', 'e98aec20-3187-48fd-a08d-dff93022bb98', '60072b9f-b29d-48af-a453-ddcd73c7511a', '2d066c25-4376-4b18-a554-074b38297997'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:07 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Deleted volume successfully. Jul 10 07:54:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Delete snapshot completed successfully. Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc82affd-70be-4460-9ce9-c5c2971326f3 tempest-VolumesServicesTestJSON-413901152 None] Lock "cinder-45469435-4e36-4d92-8816-b32f2c98d57b-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2685bcc5-b66c-4537-8505-4a3d0c0cfc9f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-fd5cfbba-2258-4307-aa75-33eb0c5eb214-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:08 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-791815fd-9061-4f26-957e-e40b68388d33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0abe800a-ebaa-4ea4-8626-45165e6f1524', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:54:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f068cafd-858e-4b47-86d9-c56fdac1b8b7 req-9c6d888d-654d-4f6e-b090-92e8fbd6fcef tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] attachment_update completed successfully. Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-8ed1250f-3830-46a5-b42a-2875d197c60e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-8ed1250f-3830-46a5-b42a-2875d197c60e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fbedc1-bd0c-4a1e-bfdd-f18312feb1cb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:08 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:54:08 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:09 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:09 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e Jul 10 07:54:09 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:10 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8ed1250f-3830-46a5-b42a-2875d197c60e" returned: 0 in 0.721s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8ed1250f-3830-46a5-b42a-2875d197c60e" released by "delete_volume" :: held 1.700s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['7abcf129-da01-4e8d-b890-b2499d9863c2', '489200d9-9b37-4071-98de-07a1a1a6f5d5', '75f3b819-b3ae-4bc0-a2d5-fa33f191cc7f', 'f10985cd-affb-4321-88ce-b6f968d37d76'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:10 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:10 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:11 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Deleted volume successfully. Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51221bd2-cdc8-47fb-8ea8-edea4b08f528 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-8ed1250f-3830-46a5-b42a-2875d197c60e-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (406c5011-1852-4c41-98d0-80cfbe6f49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175955b5-a560-4975-9d8a-3fe4a9f484b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175955b5-a560-4975-9d8a-3fe4a9f484b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-470703664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db0bf53-1092-4f0f-9469-0d3c260ff6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:12Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0741a23-e503-4f07-b183-47c5693eeb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0741a23-e503-4f07-b183-47c5693eeb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cc19ae-2ef0-43c8-a3cc-303ce93a2b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cc19ae-2ef0-43c8-a3cc-303ce93a2b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db0bf53-1092-4f0f-9469-0d3c260ff6b8', 'volume_name': 'volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a7c79-d048-4706-b6a7-600c13abd0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a7c79-d048-4706-b6a7-600c13abd0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162797c8-2efd-4a44-a1af-7e49cb01cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Volume 8db0bf53-1092-4f0f-9469-0d3c260ff6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8', 'volume_size': 1} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-470703664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db0bf53-1092-4f0f-9469-0d3c260ff6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:12Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Creating volume 8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:11 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 1073741824 Jul 10 07:54:11 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:12 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 1073741824" returned: 0 in 0.968s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:12 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:12 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:13 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.589s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162797c8-2efd-4a44-a1af-7e49cb01cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adb28a6-f0da-4070-a21d-be5de82a51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c681c1c-bffa-4c91-89f7-900f54cba166]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Volume volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 (8db0bf53-1092-4f0f-9469-0d3c260ff6b8): created successfully Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adb28a6-f0da-4070-a21d-be5de82a51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (406c5011-1852-4c41-98d0-80cfbe6f49a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d20e3769-2b14-47e0-b12e-9af698a84de1 tempest-VolumesSnapshotTestJSON-42414070 None] Created volume successfully. Jul 10 07:54:13 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 Jul 10 07:54:13 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:14 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476" returned: 0 in 0.803s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-768aee09-b961-4e01-889c-f8b10ee2b476', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '350b04a1-1019-4c75-9421-c0d53bde2881', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Creating offline snapshot 7f22d334-678e-4b74-b11e-c152c90e96cb of volume 8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[febec364-6479-4070-a7fc-6fcac36cb774]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1badb985-4da8-4e49-9771-ac69448f4cb1 req-0ee38b46-2470-4467-afb8-753086eaa2a4 tempest-AttachVolumeTestJSON-416015785 None] attachment_update completed successfully. Jul 10 07:54:14 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:14 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Flow 'volume_create_manager' (4954b086-8dfb-4186-ad05-1c30e2a2e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe360cb-fda0-4856-8b4a-2b1dd49a3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe360cb-fda0-4856-8b4a-2b1dd49a3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-389531252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a6437a-be18-4ae9-94c0-f256ae31cac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d828366a822a40a1b5905dfb7d7fca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:15Z,use_quota=True,user_id='750658c165954f208d17203c519dcdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2baa8cd6-06be-43c7-bc88-46e29c4da697),volume_type_id=2baa8cd6-06be-43c7-bc88-46e29c4da697)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27b58f7-c7e5-4da7-94dd-5105696470bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27b58f7-c7e5-4da7-94dd-5105696470bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5217ecf-8df4-4053-b4be-9929e1ce4195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5217ecf-8df4-4053-b4be-9929e1ce4195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a6437a-be18-4ae9-94c0-f256ae31cac7', 'volume_name': 'volume-87a6437a-be18-4ae9-94c0-f256ae31cac7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f9377-9bb7-499b-8728-d635002b4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f9377-9bb7-499b-8728-d635002b4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50292775-7d87-4bab-8122-849bba6f0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Volume 87a6437a-be18-4ae9-94c0-f256ae31cac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a6437a-be18-4ae9-94c0-f256ae31cac7', 'volume_size': 1} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:15 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 0.828s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:15 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb 1G Jul 10 07:54:15 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-c0b7ad8a-ee9e-4206-b317-d127a85ddb86 req-1b5757ed-cf1d-4ad7-84c6-e016755805e8 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Terminate volume connection completed successfully. Jul 10 07:54:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-c0b7ad8a-ee9e-4206-b317-d127a85ddb86 req-1b5757ed-cf1d-4ad7-84c6-e016755805e8 tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Deleting attachment 0abe800a-ebaa-4ea4-8626-45165e6f1524. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:54:16 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb 1G" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:16 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:16 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:16 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:16 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb is being set with open permissions: ugo+rw Jul 10 07:54:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:16 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:16 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:17 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:17 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info Jul 10 07:54:17 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "cinder-791815fd-9061-4f26-957e-e40b68388d33-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "cinder-791815fd-9061-4f26-957e-e40b68388d33-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "cinder-quobyte-791815fd-9061-4f26-957e-e40b68388d33" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "cinder-quobyte-791815fd-9061-4f26-957e-e40b68388d33" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a14e0d-c4f1-4603-8cd1-8011b8b06476]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:18 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 Jul 10 07:54:18 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:18 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info is being set with open permissions: ugo+rw Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:18 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info Jul 10 07:54:18 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:18 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:18 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33 Jul 10 07:54:18 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:18 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.info" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-389531252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a6437a-be18-4ae9-94c0-f256ae31cac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d828366a822a40a1b5905dfb7d7fca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:15Z,use_quota=True,user_id='750658c165954f208d17203c519dcdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2baa8cd6-06be-43c7-bc88-46e29c4da697),volume_type_id=2baa8cd6-06be-43c7-bc88-46e29c4da697)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Creating volume 87a6437a-be18-4ae9-94c0-f256ae31cac7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:18 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:18 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 1073741824 Jul 10 07:54:18 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0cd20a9-03e4-4a01-b6d8-8d025d4a0648 tempest-VolumesSnapshotTestJSON-42414070 None] Create snapshot completed successfully Jul 10 07:54:19 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-791815fd-9061-4f26-957e-e40b68388d33" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "cinder-quobyte-791815fd-9061-4f26-957e-e40b68388d33" released by "delete_volume" :: held 1.569s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Created reservations ['8a3cff53-5e04-46cb-8b90-f6fd088196a8', 'f7050ca2-9e8f-44b7-b15d-6ab4155ffa24', 'ba47d5d1-93e8-44ae-866c-b7e6cd98adf2', 'b0c4ed5c-3224-44ad-a47a-d9a241c474c5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:19 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:19 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:19 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 1073741824" returned: 0 in 1.028s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:19 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 Jul 10 07:54:19 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (8626b226-41c4-41ce-862d-d9644bed2b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9abbb60-aca0-4e84-91ea-b3eb42ce2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9abbb60-aca0-4e84-91ea-b3eb42ce2da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1280461804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550759ac-534a-46ad-b3eb-2b8f5f763241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:20Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77df12c2-4d6e-428e-b0d0-746937c4e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77df12c2-4d6e-428e-b0d0-746937c4e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab89c4a3-8bfe-4567-9cac-43a4c1599197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab89c4a3-8bfe-4567-9cac-43a4c1599197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550759ac-534a-46ad-b3eb-2b8f5f763241', 'volume_name': 'volume-550759ac-534a-46ad-b3eb-2b8f5f763241', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2855864-aa10-4acc-ab97-15a9f11ee9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2855864-aa10-4acc-ab97-15a9f11ee9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf9b8b5-7c47-44cd-9ebb-be0c0bff87e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Volume 550759ac-534a-46ad-b3eb-2b8f5f763241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550759ac-534a-46ad-b3eb-2b8f5f763241', 'volume_size': 1} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (9a7215f6-26fa-476e-95ec-cd1bc21785b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2e4e7-e6e1-4694-837b-821462575249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2e4e7-e6e1-4694-837b-821462575249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1340970016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2b54e1-ca11-4252-8d38-7f3a42473a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89947dd70d4ebbafc0cd9a7b6e28c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f22d334-678e-4b74-b11e-c152c90e96cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:20Z,use_quota=True,user_id='c1bd32288ce7423fb8670628b26ef415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f146478-4a5b-4a05-9052-790e1c37ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f146478-4a5b-4a05-9052-790e1c37ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c9efbf-8a99-4352-9362-f0f790510a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c9efbf-8a99-4352-9362-f0f790510a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f2b54e1-ca11-4252-8d38-7f3a42473a66', 'volume_name': 'volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66', 'volume_size': 1, 'snapshot_id': '7f22d334-678e-4b74-b11e-c152c90e96cb'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f642e5f-41d3-4243-a230-c33a3d053805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f642e5f-41d3-4243-a230-c33a3d053805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b088e5-67b8-44aa-9610-d9e7cc75707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume 3f2b54e1-ca11-4252-8d38-7f3a42473a66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66', 'volume_size': 1, 'snapshot_id': '7f22d334-678e-4b74-b11e-c152c90e96cb'} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:20 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.041s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Deleted volume successfully. Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9cf2ba9-4f10-4f1c-97ed-e498598fca6a tempest-TestServerVolumeAttachScenarioOldVersion-1459287006 None] Lock "cinder-791815fd-9061-4f26-957e-e40b68388d33-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:20 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1280461804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550759ac-534a-46ad-b3eb-2b8f5f763241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb788a2021d64172995ebcd536887c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:20Z,use_quota=True,user_id='ccc7fe83910c47238779f2cddcc7e9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Creating volume 550759ac-534a-46ad-b3eb-2b8f5f763241 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50292775-7d87-4bab-8122-849bba6f0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a6437a-be18-4ae9-94c0-f256ae31cac7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 1073741824 Jul 10 07:54:20 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f400045-3711-498e-9b68-79c21c060628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Volume volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 (87a6437a-be18-4ae9-94c0-f256ae31cac7): created successfully Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f400045-3711-498e-9b68-79c21c060628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Flow 'volume_create_manager' (4954b086-8dfb-4186-ad05-1c30e2a2e415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-39cc370e-0078-4593-a1b7-1cc2fda4d8e1 tempest-VolumeTypesAccessTest-84166472 None] Created volume successfully. Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Acquiring lock "cinder-87a6437a-be18-4ae9-94c0-f256ae31cac7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "cinder-87a6437a-be18-4ae9-94c0-f256ae31cac7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Acquiring lock "cinder-quobyte-87a6437a-be18-4ae9-94c0-f256ae31cac7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "cinder-quobyte-87a6437a-be18-4ae9-94c0-f256ae31cac7" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba03fc-a8e7-4f5a-a37a-1bb27fc19125]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:21 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 Jul 10 07:54:21 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:21 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 1073741824" returned: 0 in 0.909s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:21 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 Jul 10 07:54:21 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:22 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7" returned: 0 in 0.971s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:22 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7 Jul 10 07:54:22 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:22 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.936s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb-3f2b54e1-ca11-4252-8d38-7f3a42473a66" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf9b8b5-7c47-44cd-9ebb-be0c0bff87e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550759ac-534a-46ad-b3eb-2b8f5f763241', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ddaef1-da1c-45f7-b829-5e45af1c4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb-3f2b54e1-ca11-4252-8d38-7f3a42473a66" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Creating volume 3f2b54e1-ca11-4252-8d38-7f3a42473a66 from snapshot 7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Volume volume-550759ac-534a-46ad-b3eb-2b8f5f763241 (550759ac-534a-46ad-b3eb-2b8f5f763241): created successfully Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ddaef1-da1c-45f7-b829-5e45af1c4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Flow 'volume_create_manager' (8626b226-41c4-41ce-862d-d9644bed2b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] snapshot: 7f22d334-678e-4b74-b11e-c152c90e96cb, volume: 3f2b54e1-ca11-4252-8d38-7f3a42473a66, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:54:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7920f68a-0c2b-4a2e-8524-12c34ba10a95 tempest-AttachVolumeTestJSON-416015785 None] Created volume successfully. Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcf2ec-9b88-453e-9c50-45646712f802]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:22 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:22 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:23 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-87a6437a-be18-4ae9-94c0-f256ae31cac7" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "cinder-quobyte-87a6437a-be18-4ae9-94c0-f256ae31cac7" released by "delete_volume" :: held 1.849s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:23 devstack cinder-volume[87192]: WARNING cinder.quota [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-87009781 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-87009781, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:54:23 devstack cinder-volume[87192]: WARNING cinder.quota [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-87009781 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-87009781, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Created reservations ['f259551f-25c8-4fe3-a9aa-4a7f94d207f1', 'c71c9343-7e26-48d1-a3e4-40c9af39e18f', '05372486-6c72-4e61-a67d-b6d04f132bf4', 'b4ecc054-3ccc-4b4b-9b12-869663038b36'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:23 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:23 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:23 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 0.900s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c9a2e8-26de-4ede-9fa5-b833b416686c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:23 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:23 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:24 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Deleted volume successfully. Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a77575a-63c7-492e-b859-99f4ad62e15b tempest-VolumeTypesAccessTest-84166472 None] Lock "cinder-87a6437a-be18-4ae9-94c0-f256ae31cac7-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:24 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 0.943s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:54:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:24 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 Jul 10 07:54:24 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:30 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66" returned: 0 in 6.190s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d43baa-ca3b-4e32-95ad-2e878a18168d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:30 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:30 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:31 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:31 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:54:31 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Converted 1024.00 MB image at 165.38 MB/s Jul 10 07:54:31 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 is being set with open permissions: ugo+rw Jul 10 07:54:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:31 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 Jul 10 07:54:31 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:32 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" released by "_copy_volume_from_snapshot" :: held 9.967s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb-3f2b54e1-ca11-4252-8d38-7f3a42473a66" released by "_create_volume_from_snapshot" :: held 10.027s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.078s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.220s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db828eef-90a4-4b08-8a89-f6d3f0fa9dc3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b088e5-67b8-44aa-9610-d9e7cc75707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66', 'volume_size': 1, 'snapshot_id': '7f22d334-678e-4b74-b11e-c152c90e96cb'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29040f7-82d5-4475-9dfb-976f776fb743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Volume volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 (3f2b54e1-ca11-4252-8d38-7f3a42473a66): created successfully Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29040f7-82d5-4475-9dfb-976f776fb743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Flow 'volume_create_manager' (9a7215f6-26fa-476e-95ec-cd1bc21785b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dc528e12-1b47-463c-97fe-d6e07ed4a8a8 tempest-VolumesSnapshotTestJSON-42414070 None] Created volume successfully. Jul 10 07:54:32 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 Jul 10 07:54:32 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:33 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241" returned: 0 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-550759ac-534a-46ad-b3eb-2b8f5f763241', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a9c11d8-cc87-4ffb-ac1a-cb1db3c336a1', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:54:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-c11b3391-c49c-49cf-b00d-be3e75ef91ef req-5d5b36e6-2fee-460a-bb32-a026c07ca331 tempest-AttachVolumeTestJSON-416015785 None] attachment_update completed successfully. Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-3f2b54e1-ca11-4252-8d38-7f3a42473a66-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-3f2b54e1-ca11-4252-8d38-7f3a42473a66-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df200bc-37b5-4dba-80ec-b3da052bbb6d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:34 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 Jul 10 07:54:34 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:35 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66" returned: 0 in 1.135s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:35 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66 Jul 10 07:54:35 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:36 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3f2b54e1-ca11-4252-8d38-7f3a42473a66" returned: 0 in 0.740s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-3f2b54e1-ca11-4252-8d38-7f3a42473a66" released by "delete_volume" :: held 1.934s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['d5bc943b-b32a-4874-924e-cb461e0ccf04', '73b76bb3-1bdf-42b1-b89e-4287b337cd72', 'bca9573b-c126-45a6-afdc-548d090eb522', '2023dc3c-aa07-42cc-863f-31a41bcade0d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:36 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:36 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:36 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:36 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-7f22d334-678e-4b74-b11e-c152c90e96cb-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-7f22d334-678e-4b74-b11e-c152c90e96cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Deleting offline snapshot 7f22d334-678e-4b74-b11e-c152c90e96cb of volume 8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] snapshot_file for this snap is: volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[85839d86-1047-408a-8570-c6a367d5b6b2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:36 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:36 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:37 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:37 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.074s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.164s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:54:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Deleted volume successfully. Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39558f83-a994-4725-8ef4-03bf48be95fa tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-3f2b54e1-ca11-4252-8d38-7f3a42473a66-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:37 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 1.113s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ea9ec-bfba-41a2-988b-84ad61c97c30]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:38 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:38 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:38 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 1.021s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:38 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:38 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:39 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 0.987s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:39 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb Jul 10 07:54:39 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=92,cinder:INSERT=28,cinder:UPDATE=105,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:54:40 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=98,cinder:INSERT=21,cinder:UPDATE=105,cinder:DELETE=12 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8.7f22d334-678e-4b74-b11e-c152c90e96cb" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f598e18b-e34c-46c7-b28e-80e0b9da8246 req-be2ee20b-5625-4262-9f9c-d8e7b1762659 tempest-AttachVolumeTestJSON-416015785 None] Terminate volume connection completed successfully. Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f598e18b-e34c-46c7-b28e-80e0b9da8246 req-be2ee20b-5625-4262-9f9c-d8e7b1762659 tempest-AttachVolumeTestJSON-416015785 None] Deleting attachment 350b04a1-1019-4c75-9421-c0d53bde2881. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-7f22d334-678e-4b74-b11e-c152c90e96cb" released by "_delete_snapshot" :: held 4.089s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" released by "delete_snapshot" :: held 4.138s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['c2e7b5dc-c211-4927-a1a5-168e8876c7df', '8f6f2666-7f07-4ff2-ae67-d1f8cf800d67', '96abf3fb-ab6d-4df4-8013-b365b8ac51ce', 'df24236d-4b03-4abe-b51e-2eb100409608'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Delete snapshot completed successfully. Jul 10 07:54:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a037be63-a928-4b0e-83c1-592eae6f4a4b tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-7f22d334-678e-4b74-b11e-c152c90e96cb-delete_snapshot" released by "delete_snapshot" :: held 4.380s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-8db0bf53-1092-4f0f-9469-0d3c260ff6b8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-8db0bf53-1092-4f0f-9469-0d3c260ff6b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be820c5-a8ef-4037-9943-5f1522e5138f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (cbe9160a-5eff-4fdd-9e82-009bc11cd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e436a74f-3165-4d8e-892b-b7799c098be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e436a74f-3165-4d8e-892b-b7799c098be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-138112690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c1717d-dabe-47e8-a802-547345cdec5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:42Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455cec24-f06f-491c-8066-f6d20a204180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:41 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455cec24-f06f-491c-8066-f6d20a204180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:41 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634e771a-891b-4c13-b692-e1f31bb59cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634e771a-891b-4c13-b692-e1f31bb59cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c1717d-dabe-47e8-a802-547345cdec5b', 'volume_name': 'volume-48c1717d-dabe-47e8-a802-547345cdec5b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4f2bb-4027-491e-acde-ef3d65c70108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4f2bb-4027-491e-acde-ef3d65c70108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ec5c67-9ac4-4fcf-af94-58c10d84b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Volume 48c1717d-dabe-47e8-a802-547345cdec5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c1717d-dabe-47e8-a802-547345cdec5b', 'volume_size': 1} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-138112690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c1717d-dabe-47e8-a802-547345cdec5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:42Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Creating volume 48c1717d-dabe-47e8-a802-547345cdec5b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:41 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:41 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b 1073741824 Jul 10 07:54:41 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:42 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 0.966s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:42 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8 Jul 10 07:54:42 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:42 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b 1073741824" returned: 0 in 0.994s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:42 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b Jul 10 07:54:42 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:43 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" returned: 0 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-8db0bf53-1092-4f0f-9469-0d3c260ff6b8" released by "delete_volume" :: held 1.789s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-5d40ff6e-adbc-434e-a04d-95baa24287b6 req-a3dceee5-14bf-4e7c-a27a-0d1d430e7028 tempest-AttachVolumeTestJSON-416015785 None] Terminate volume connection completed successfully. Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-5d40ff6e-adbc-434e-a04d-95baa24287b6 req-a3dceee5-14bf-4e7c-a27a-0d1d430e7028 tempest-AttachVolumeTestJSON-416015785 None] Deleting attachment 6a9c11d8-cc87-4ffb-ac1a-cb1db3c336a1. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['988d99cc-001e-4483-9344-6a8bb7f07ee1', '26799cf3-5bd0-4751-a961-de64748a54f2', '9a0acaf8-36f7-4213-ae16-de16ce42c0a5', '4ea02456-b0d6-4efa-8c27-b197906065e8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:43 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:43 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:43 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ec5c67-9ac4-4fcf-af94-58c10d84b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c1717d-dabe-47e8-a802-547345cdec5b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ba802-e4c2-4381-b9be-83f423c81862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Volume volume-48c1717d-dabe-47e8-a802-547345cdec5b (48c1717d-dabe-47e8-a802-547345cdec5b): created successfully Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ba802-e4c2-4381-b9be-83f423c81862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (cbe9160a-5eff-4fdd-9e82-009bc11cd687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b02a0461-331c-477c-8ec6-9666756bb20b tempest-VolumesListAdminTestJSON-597421704 None] Created volume successfully. Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-43c289ff-5595-4fb1-8fda-5c664f1826a9-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-43c289ff-5595-4fb1-8fda-5c664f1826a9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f201026-2726-4261-aff7-5227128c5041]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:44 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 Jul 10 07:54:44 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:44 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Deleted volume successfully. Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7b60b807-6db9-4bbc-9e11-cbf48602d23f tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-8db0bf53-1092-4f0f-9469-0d3c260ff6b8-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:44 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9" returned: 0 in 0.897s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:44 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9 Jul 10 07:54:44 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (d553bed3-9ef7-4e5a-9521-64eb0b9e0c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6259940d-8684-41ec-84b3-d241e005af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6259940d-8684-41ec-84b3-d241e005af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1808887531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:45Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916f16a5-9f82-4223-b33a-c2e476b88d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916f16a5-9f82-4223-b33a-c2e476b88d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed5fe97-0398-420a-976b-8ec63dcace0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed5fe97-0398-420a-976b-8ec63dcace0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6', 'volume_name': 'volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4627f73-fbd0-4b89-8c75-54b11cef9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4627f73-fbd0-4b89-8c75-54b11cef9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0adf6c-09d6-490e-b6b2-33ba6b7d0105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Volume 4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6', 'volume_size': 1} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1808887531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:45Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Creating volume 4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:45 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:45 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 1073741824 Jul 10 07:54:45 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:45 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-43c289ff-5595-4fb1-8fda-5c664f1826a9" returned: 0 in 0.729s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-quobyte-43c289ff-5595-4fb1-8fda-5c664f1826a9" released by "delete_volume" :: held 1.737s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Created reservations ['f7ef751f-a2d7-4eae-b894-c2944730ea18', '993ed4f4-89cc-4f29-83e5-139fbd0ea439', '39d416cb-2772-4816-b31f-32f77f5bb371', 'f4e3b604-a760-44e1-9c64-328a192dda27'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:45 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:45 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:46 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 1073741824" returned: 0 in 1.256s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:46 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:54:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Deleted volume successfully. Jul 10 07:54:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e05f86dd-b557-4bc6-96c9-21585ec98f72 tempest-VolumesSnapshotTestJSON-42414070 None] Lock "cinder-43c289ff-5595-4fb1-8fda-5c664f1826a9-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:46 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 Jul 10 07:54:46 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:47 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0adf6c-09d6-490e-b6b2-33ba6b7d0105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ff9c99-5be9-493a-b34e-419f755a2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Volume volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 (4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6): created successfully Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ff9c99-5be9-493a-b34e-419f755a2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (d553bed3-9ef7-4e5a-9521-64eb0b9e0c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d0bef70a-501f-48f8-b79a-1102c353bc26 tempest-VolumesListAdminTestJSON-597421704 None] Created volume successfully. Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (94210170-e781-4e9d-82fb-0f6ad0961653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88443aa3-6893-4bc8-a307-ac4380537b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88443aa3-6893-4bc8-a307-ac4380537b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-535028573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c323e6b-aa54-4d4c-a62a-af55809fecdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:49Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94738ab-bf60-49f7-a0f4-aa73babcb520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94738ab-bf60-49f7-a0f4-aa73babcb520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f49929-00f5-4a5a-8b85-6c6ab2ea8e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f49929-00f5-4a5a-8b85-6c6ab2ea8e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c323e6b-aa54-4d4c-a62a-af55809fecdb', 'volume_name': 'volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a6cc8a-9fcf-44bb-9697-02b07e6fefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a6cc8a-9fcf-44bb-9697-02b07e6fefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b21d2-bb78-4c05-88aa-a727cf7e7317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Volume 6c323e6b-aa54-4d4c-a62a-af55809fecdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb', 'volume_size': 1} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-535028573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c323e6b-aa54-4d4c-a62a-af55809fecdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0e50e04314f9bb5df2601a9c0e873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:49Z,use_quota=True,user_id='b43df5b3fdb64530a5b891eb99e19909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Creating volume 6c323e6b-aa54-4d4c-a62a-af55809fecdb {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:49 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb 1073741824 Jul 10 07:54:49 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:50 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb 1073741824" returned: 0 in 1.051s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:50 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb Jul 10 07:54:50 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:51 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b21d2-bb78-4c05-88aa-a727cf7e7317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2267b915-3569-4790-ad5e-967c0a457f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Volume volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb (6c323e6b-aa54-4d4c-a62a-af55809fecdb): created successfully Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2267b915-3569-4790-ad5e-967c0a457f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Flow 'volume_create_manager' (94210170-e781-4e9d-82fb-0f6ad0961653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51ce5b33-7460-4f16-93f3-72a63fa86a1b tempest-VolumesListAdminTestJSON-597421704 None] Created volume successfully. Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Flow 'volume_create_manager' (2d1780d1-96ef-4121-a653-46edb9046a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac376860-7f23-477a-9300-62bf503ccb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac376860-7f23-477a-9300-62bf503ccb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe0a7af-45a2-4b29-b722-847b17aa9762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2730781fecdd4ca98d56053e06f081f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:53Z,use_quota=True,user_id='8b519ab16c6544e4a33945db7b0eeee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb94951-0517-4860-8531-c6a4b0b9f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb94951-0517-4860-8531-c6a4b0b9f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3158e853-32f4-4579-873c-331fc0f4a7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3158e853-32f4-4579-873c-331fc0f4a7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe0a7af-45a2-4b29-b722-847b17aa9762', 'volume_name': 'volume-1fe0a7af-45a2-4b29-b722-847b17aa9762', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097b9ec-1ba0-4fd2-9475-26b0d667c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097b9ec-1ba0-4fd2-9475-26b0d667c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef0113-524a-4a06-a1e0-c4baeb1aba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Volume 1fe0a7af-45a2-4b29-b722-847b17aa9762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe0a7af-45a2-4b29-b722-847b17aa9762', 'volume_size': 1} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe0a7af-45a2-4b29-b722-847b17aa9762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2730781fecdd4ca98d56053e06f081f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:53Z,use_quota=True,user_id='8b519ab16c6544e4a33945db7b0eeee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Creating volume 1fe0a7af-45a2-4b29-b722-847b17aa9762 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:53 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 1073741824 Jul 10 07:54:53 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:54 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 1073741824" returned: 0 in 1.263s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:54 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 Jul 10 07:54:54 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:55 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762" returned: 0 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef0113-524a-4a06-a1e0-c4baeb1aba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe0a7af-45a2-4b29-b722-847b17aa9762', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b95a3e-d334-477d-b3f4-2ad5c1908b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Volume volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 (1fe0a7af-45a2-4b29-b722-847b17aa9762): created successfully Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b95a3e-d334-477d-b3f4-2ad5c1908b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Flow 'volume_create_manager' (2d1780d1-96ef-4121-a653-46edb9046a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9c610532-4c25-4e8e-8170-b12ee650b9d3 tempest-VolumesListAdminTestJSON-915205070 None] Created volume successfully. Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Acquiring lock "cinder-1fe0a7af-45a2-4b29-b722-847b17aa9762-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "cinder-1fe0a7af-45a2-4b29-b722-847b17aa9762-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Acquiring lock "cinder-quobyte-1fe0a7af-45a2-4b29-b722-847b17aa9762" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "cinder-quobyte-1fe0a7af-45a2-4b29-b722-847b17aa9762" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-6c323e6b-aa54-4d4c-a62a-af55809fecdb-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d35193-93cc-4146-9438-31775b77a7d4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-6c323e6b-aa54-4d4c-a62a-af55809fecdb-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:57 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 Jul 10 07:54:57 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-quobyte-6c323e6b-aa54-4d4c-a62a-af55809fecdb" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-6c323e6b-aa54-4d4c-a62a-af55809fecdb" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ee984-7af0-4281-a987-b88c81372a8d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:57 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb Jul 10 07:54:57 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Flow 'volume_create_manager' (f3618f87-970f-4973-8846-f3d0406ef940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaed470-1f5b-48f0-95f5-764d2a1893fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaed470-1f5b-48f0-95f5-764d2a1893fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1433894612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935bd4b-8e19-4e9f-a4fa-1504bac52e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfd5b23409d40cf978a964f870b7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:58Z,use_quota=True,user_id='0617921838a34b8f8c2d6c321a401033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7069b601-c78b-4ed7-a338-0a220dc5a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7069b601-c78b-4ed7-a338-0a220dc5a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9ae63-1ad0-4d40-a091-ba43d2978b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9ae63-1ad0-4d40-a091-ba43d2978b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2935bd4b-8e19-4e9f-a4fa-1504bac52e96', 'volume_name': 'volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4170baa8-5e76-4b4a-ba19-d01914b67fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4170baa8-5e76-4b4a-ba19-d01914b67fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7442f3-7680-4c9d-867e-2a9c4ec8694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:54:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Volume 2935bd4b-8e19-4e9f-a4fa-1504bac52e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96', 'volume_size': 2} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1433894612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935bd4b-8e19-4e9f-a4fa-1504bac52e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfd5b23409d40cf978a964f870b7fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:54:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:54:58Z,use_quota=True,user_id='0617921838a34b8f8c2d6c321a401033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Creating volume 2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:54:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 2147483648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:58 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 2147483648 Jul 10 07:54:58 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:58 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762" returned: 0 in 1.183s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:58 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762 Jul 10 07:54:58 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-550759ac-534a-46ad-b3eb-2b8f5f763241-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-550759ac-534a-46ad-b3eb-2b8f5f763241-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-quobyte-550759ac-534a-46ad-b3eb-2b8f5f763241" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:54:58 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-550759ac-534a-46ad-b3eb-2b8f5f763241" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb" returned: 0 in 1.516s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[154dabb1-01af-4871-b020-6d9dd910af3e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:54:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:58 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb Jul 10 07:54:58 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:58 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 Jul 10 07:54:58 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:59 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1fe0a7af-45a2-4b29-b722-847b17aa9762" returned: 0 in 0.960s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "cinder-quobyte-1fe0a7af-45a2-4b29-b722-847b17aa9762" released by "delete_volume" :: held 2.248s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Created reservations ['b3a2cac0-8262-4a91-aac2-48780df41777', '530acd02-5631-4ef5-8e90-ed3c93061341', 'e7fc7001-283b-44c5-83e4-4ccc36452d99', 'ef3a0b44-ba5f-4b8f-a236-07d29bfab500'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:59 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:54:59 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:59 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 2147483648" returned: 0 in 1.337s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:54:59 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 Jul 10 07:54:59 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:54:59 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c323e6b-aa54-4d4c-a62a-af55809fecdb" returned: 0 in 1.015s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-6c323e6b-aa54-4d4c-a62a-af55809fecdb" released by "delete_volume" :: held 2.615s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:54:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Created reservations ['78031141-5a65-4588-b3dc-14a00470c2ad', 'c7fac4ee-7685-48a2-8421-c3f6fcc04e57', 'b31c290c-1f86-4e55-975d-3347269a9b5e', 'dd043195-794d-45a3-9cdb-367ecb73f41b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:00 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241" returned: 0 in 1.358s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:00 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:00 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:00 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241 Jul 10 07:55:00 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:00 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Deleted volume successfully. Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9c312f74-eba5-4f3c-8e4d-2736eee78133 tempest-VolumesListAdminTestJSON-915205070 None] Lock "cinder-1fe0a7af-45a2-4b29-b722-847b17aa9762-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:00 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" returned: 0 in 1.108s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7442f3-7680-4c9d-867e-2a9c4ec8694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c323c6d-5fe7-4060-a489-c6a9ff0b4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-quobyte-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Volume volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 (2935bd4b-8e19-4e9f-a4fa-1504bac52e96): created successfully Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c323c6d-5fe7-4060-a489-c6a9ff0b4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Flow 'volume_create_manager' (f3618f87-970f-4973-8846-f3d0406ef940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" acquired by "delete_volume" :: waited 0.047s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef4ccacf-ecd7-4eaf-a8ff-d773565ed66c tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Created volume successfully. Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85daedb-edef-4d9a-a13e-8b09f8675248]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:00 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:00 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 Jul 10 07:55:00 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Deleted volume successfully. Jul 10 07:55:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff1210fd-8994-4839-b8a7-c7779840e205 tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-6c323e6b-aa54-4d4c-a62a-af55809fecdb-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:00 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-550759ac-534a-46ad-b3eb-2b8f5f763241" returned: 0 in 0.928s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-550759ac-534a-46ad-b3eb-2b8f5f763241" released by "delete_volume" :: held 2.370s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Created reservations ['6dbffad5-0963-4ca0-b223-4d9f2e94ef24', '7bfd185a-1af8-4096-aafd-8e8af16096d0', '5a847777-4549-48fe-a453-e5cc11d9b6aa', '77840320-170c-4add-9acf-070e02ce02ca'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:01 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:01 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Creating offline snapshot fde946d9-4d64-47e5-bc29-d47affe8ec9a of volume 2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0f8a6-e5d1-478f-959c-63017ea525e5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:01 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 Jul 10 07:55:01 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:01 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" returned: 0 in 1.003s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:01 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6 Jul 10 07:55:01 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:01 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Deleted volume successfully. Jul 10 07:55:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-20354e65-600c-4f1a-82b7-f25c8f9d973e tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-550759ac-534a-46ad-b3eb-2b8f5f763241-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-768aee09-b961-4e01-889c-f8b10ee2b476-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-768aee09-b961-4e01-889c-f8b10ee2b476-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-quobyte-768aee09-b961-4e01-889c-f8b10ee2b476" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-768aee09-b961-4e01-889c-f8b10ee2b476" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0793ed93-7ae4-4517-b7a4-cc8156140066]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:02 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 Jul 10 07:55:02 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:02 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:02 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a 2G Jul 10 07:55:02 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:02 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6" released by "delete_volume" :: held 2.013s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Created reservations ['acaab803-1e7f-4bec-92d2-d396a973cc89', '12ff8eae-a723-4083-bbb0-e24efe0480df', 'e8f99b58-da7f-4554-8ffc-07d51876cab1', '06f49f2e-98cb-48ad-9cad-a9dd430a1a90'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:02 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:02 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:03 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476" returned: 0 in 1.082s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:03 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476 Jul 10 07:55:03 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:03 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a 2G" returned: 0 in 1.077s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:03 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Deleted volume successfully. Jul 10 07:55:03 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a Jul 10 07:55:03 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f2047aa-6ca8-4f1b-929f-ad9eca9e280b tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-4d1ffe7e-3bd8-4a6d-b65f-c019504c0cb6-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-48c1717d-dabe-47e8-a802-547345cdec5b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-48c1717d-dabe-47e8-a802-547345cdec5b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:04 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "cinder-quobyte-48c1717d-dabe-47e8-a802-547345cdec5b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-768aee09-b961-4e01-889c-f8b10ee2b476" returned: 0 in 0.881s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-768aee09-b961-4e01-889c-f8b10ee2b476" released by "delete_volume" :: held 2.021s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-48c1717d-dabe-47e8-a802-547345cdec5b" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[124e4f0b-f55d-4cf2-9ed6-415afb3dd318]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Created reservations ['c6a4cfc3-41e6-45f2-88e8-b6ac82f467ab', 'be3f1fe2-d3aa-4457-8def-66bf248fd883', '92da8fb9-5c9e-4e49-a7cf-f69281b5ef6d', '2c2c55f5-9b85-4745-a321-a4f12ceb8ae7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:04 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b Jul 10 07:55:04 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:04 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:04 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a is being set with open permissions: ugo+rw Jul 10 07:55:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:04 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:04 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:04 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a Jul 10 07:55:04 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:05 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:05 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Deleted volume successfully. Jul 10 07:55:05 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b Jul 10 07:55:05 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-51f20a10-d517-4779-848b-a31c778b00f5 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-768aee09-b961-4e01-889c-f8b10ee2b476-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:05 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a" returned: 0 in 0.890s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:05 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info Jul 10 07:55:05 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-26c3c08f-40c0-4be1-8dc5-42a124d82724-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-26c3c08f-40c0-4be1-8dc5-42a124d82724-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "cinder-quobyte-26c3c08f-40c0-4be1-8dc5-42a124d82724" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-26c3c08f-40c0-4be1-8dc5-42a124d82724" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[890bc6f2-0f61-4e5a-9a62-7cb9d1521a54]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:05 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 Jul 10 07:55:05 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:06 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-48c1717d-dabe-47e8-a802-547345cdec5b" returned: 0 in 1.147s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-quobyte-48c1717d-dabe-47e8-a802-547345cdec5b" released by "delete_volume" :: held 2.174s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:06 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Created reservations ['930d6c85-6fe5-4bc1-9cb7-2d28bef16478', '58b54e1e-9795-428f-b05c-816eb9da7fab', 'c5125b78-aaf5-41d0-903d-5e97985fcab3', 'c94e5aa4-7eb2-4392-8fa6-0607f563500f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info" returned: 0 in 1.081s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:06 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info is being set with open permissions: ugo+rw Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:06 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info Jul 10 07:55:06 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:06 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:06 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:06 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724" returned: 0 in 1.182s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:07 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724 Jul 10 07:55:07 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:07 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.info" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.888s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-142257ea-9fc5-485d-95f7-31fe3c59a4a7 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Create snapshot completed successfully Jul 10 07:55:07 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Deleted volume successfully. Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf8ea824-554a-435b-bb39-e8e35dd0405f tempest-VolumesListAdminTestJSON-597421704 None] Lock "cinder-48c1717d-dabe-47e8-a802-547345cdec5b-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:07 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26c3c08f-40c0-4be1-8dc5-42a124d82724" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-quobyte-26c3c08f-40c0-4be1-8dc5-42a124d82724" released by "delete_volume" :: held 2.038s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Created reservations ['373c8e52-3229-4e8f-a64b-746ef7ae410a', '8b076f6b-915f-47e2-99b4-954aa18ebeb0', 'c7fef811-5d3d-4f98-bd56-af34a944d5c8', 'd18d9677-70c8-4e1e-87d5-6a9ff8b0d645'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "cinder-fde946d9-4d64-47e5-bc29-d47affe8ec9a-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:08 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:08 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-fde946d9-4d64-47e5-bc29-d47affe8ec9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "cinder-quobyte-fde946d9-4d64-47e5-bc29-d47affe8ec9a" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-fde946d9-4d64-47e5-bc29-d47affe8ec9a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Deleting offline snapshot fde946d9-4d64-47e5-bc29-d47affe8ec9a of volume 2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] snapshot_file for this snap is: volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ccc3e9-8270-4672-929d-b6dee05a2ede]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:08 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a Jul 10 07:55:08 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:08 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Deleted volume successfully. Jul 10 07:55:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0e81ab84-b5b1-4e36-b6d5-72883e806af2 tempest-AttachVolumeTestJSON-416015785 None] Lock "cinder-26c3c08f-40c0-4be1-8dc5-42a124d82724-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:09 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a" returned: 0 in 0.986s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:55:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285312b-0123-44f2-b3cc-0835792a5bd8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:09 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 Jul 10 07:55:09 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:10 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:10 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a Jul 10 07:55:10 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:10 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:10 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a Jul 10 07:55:10 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Flow 'volume_create_manager' (4b6b6947-aed4-43b9-8170-780f3a82214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5d761f-e639-4f55-9b8a-9f6800d81e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5d761f-e639-4f55-9b8a-9f6800d81e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1096298045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1a3fa1-c515-4526-ac93-b476b01eb915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7b07e20c8c46a8b54dbcb2f392ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:11Z,use_quota=True,user_id='2a3d050414f045958ef24d86d1d7c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60b9ef4-cd18-4807-9b06-71bfad98a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60b9ef4-cd18-4807-9b06-71bfad98a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e107e9d-30d0-4732-b3cd-e4b870fd5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e107e9d-30d0-4732-b3cd-e4b870fd5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1a3fa1-c515-4526-ac93-b476b01eb915', 'volume_name': 'volume-9b1a3fa1-c515-4526-ac93-b476b01eb915', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f867c6d-5ea7-402e-b27c-7f2c7eda8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f867c6d-5ea7-402e-b27c-7f2c7eda8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3373a84d-b62c-4052-a487-fa4f0fba477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Volume 9b1a3fa1-c515-4526-ac93-b476b01eb915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1a3fa1-c515-4526-ac93-b476b01eb915', 'volume_size': 1} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1096298045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1a3fa1-c515-4526-ac93-b476b01eb915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7b07e20c8c46a8b54dbcb2f392ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:11Z,use_quota=True,user_id='2a3d050414f045958ef24d86d1d7c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Creating volume 9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:11 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 1073741824 Jul 10 07:55:11 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:12 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96.fde946d9-4d64-47e5-bc29-d47affe8ec9a" returned: 0 in 1.148s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-fde946d9-4d64-47e5-bc29-d47affe8ec9a" released by "_delete_snapshot" :: held 4.016s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" released by "delete_snapshot" :: held 4.054s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Created reservations ['90180d0e-2883-489e-9997-1711f6bec85a', '18782fd5-daeb-4cbf-92f2-9d1f782f092e', 'd4eb46d7-cb36-4498-97c6-68a2108b4e10', '274f3d7f-0c14-41e0-a965-b4f4fa2e5607'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Delete snapshot completed successfully. Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3ca68e3f-bf02-4ffc-b92a-abcb8627c0d8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-fde946d9-4d64-47e5-bc29-d47affe8ec9a-delete_snapshot" released by "delete_snapshot" :: held 4.290s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:12 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 1073741824" returned: 0 in 1.318s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:12 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:55:12 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "cinder-2935bd4b-8e19-4e9f-a4fa-1504bac52e96-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-2935bd4b-8e19-4e9f-a4fa-1504bac52e96-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:13 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 1.048s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3373a84d-b62c-4052-a487-fa4f0fba477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1a3fa1-c515-4526-ac93-b476b01eb915', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576df4bb-54a5-419a-930f-ecf5fbaff31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca827e1-9dd3-4bc8-86bd-f0a97d6c21ca]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Volume volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 (9b1a3fa1-c515-4526-ac93-b476b01eb915): created successfully Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576df4bb-54a5-419a-930f-ecf5fbaff31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Flow 'volume_create_manager' (4b6b6947-aed4-43b9-8170-780f3a82214a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eeb5f835-c488-4c60-aac2-9e9342254f98 tempest-TestStampPattern-480241403 None] Created volume successfully. Jul 10 07:55:14 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 Jul 10 07:55:14 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Flow 'volume_create_manager' (a01eb0bc-2354-4ae2-a598-e05d62091c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab752a5-db10-42cd-963b-9dffe46d0af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab752a5-db10-42cd-963b-9dffe46d0af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-269715354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429b622daf634744b0e9a073eabe9900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:14Z,use_quota=True,user_id='f131e6215f86480aa07b6b6886d667d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6beede0f-5874-4316-b907-420dc8b45f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6beede0f-5874-4316-b907-420dc8b45f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe1af8-838e-4902-b8bf-0d6d281e68c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe1af8-838e-4902-b8bf-0d6d281e68c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf', 'volume_name': 'volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74b3a36-ab76-4183-84fe-3df1c7a1aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74b3a36-ab76-4183-84fe-3df1c7a1aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:14 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed156fdc-b992-403c-ad40-e29f7550d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Trying to clone b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" returned: 0 in 1.079s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:14 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96 Jul 10 07:55:14 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:55:15 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Image download 20.69 MB at 20.69 MB/s Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bc8fd-fcff-4d75-a511-a174358ecb5b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:15 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD Jul 10 07:55:15 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:15 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" returned: 0 in 0.859s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-quobyte-2935bd4b-8e19-4e9f-a4fa-1504bac52e96" released by "delete_volume" :: held 2.050s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Created reservations ['c01adc45-32a9-465e-bb5d-d4382fe862ad', '81ab3b06-dd5d-4c6b-848a-a1cbbeb3f2a8', 'b1d2e1ec-49cd-4369-9139-4d8c878d71a8', '0132662c-e50a-452d-a62d-7cca8e1fc849'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:15 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:15 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:16 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 is fetched for user f131e6215f86480aa07b6b6886d667d8. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68bbf7e-931f-4388-9491-5c0e28316418]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:16 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD Jul 10 07:55:16 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:16 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Deleted volume successfully. Jul 10 07:55:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e748a04-352d-458d-9165-c42548b909f8 tempest-VolumesSnapshotNegativeTestJSON-1859989895 None] Lock "cinder-2935bd4b-8e19-4e9f-a4fa-1504bac52e96-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:17 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-269715354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429b622daf634744b0e9a073eabe9900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:14Z,use_quota=True,user_id='f131e6215f86480aa07b6b6886d667d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Creating volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:17 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:17 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1073741824 Jul 10 07:55:17 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:18 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1073741824" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:18 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:18 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Flow 'volume_create_manager' (2a9d8534-c86b-4ecb-be07-e353dc8a6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25891a4a-4f47-49df-b92d-bb78488e41e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25891a4a-4f47-49df-b92d-bb78488e41e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1428654535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96fe189-4089-45f5-87c6-2c44d5ee4c03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='745afeb95fd245279a5c7819b0b49ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:19Z,use_quota=True,user_id='e687f9a8aed24fbbac3b49ffbcaea5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9d5f54-9019-4ae9-b2fc-68445d770fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9d5f54-9019-4ae9-b2fc-68445d770fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80d5e81-63a4-40de-b327-0394ed6c65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80d5e81-63a4-40de-b327-0394ed6c65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96fe189-4089-45f5-87c6-2c44d5ee4c03', 'volume_name': 'volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3ffde0-c971-454e-86c9-479fe17919f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3ffde0-c971-454e-86c9-479fe17919f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322b209b-689d-4a8d-9203-37e6a837f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Volume c96fe189-4089-45f5-87c6-2c44d5ee4c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03', 'volume_size': 1} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:19 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 0 in 1.080s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1428654535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96fe189-4089-45f5-87c6-2c44d5ee4c03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='745afeb95fd245279a5c7819b0b49ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:19Z,use_quota=True,user_id='e687f9a8aed24fbbac3b49ffbcaea5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Creating volume c96fe189-4089-45f5-87c6-2c44d5ee4c03 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:19 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:19 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 1073741824 Jul 10 07:55:19 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Attempting download of 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c40f4e8-bd56-4572-931a-3bc3137ca023]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:19 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa Jul 10 07:55:19 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:20 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 1073741824" returned: 0 in 1.400s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:20 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa" returned: 0 in 1.355s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:20 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 Jul 10 07:55:20 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:21 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa Jul 10 07:55:21 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:21 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03" returned: 0 in 1.012s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.484s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322b209b-689d-4a8d-9203-37e6a837f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccff6adb-2886-4064-a072-67359e1c06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Volume volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 (c96fe189-4089-45f5-87c6-2c44d5ee4c03): created successfully Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccff6adb-2886-4064-a072-67359e1c06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Flow 'volume_create_manager' (2a9d8534-c86b-4ecb-be07-e353dc8a6103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-479f69c8-af27-4a97-867c-9f2f8fdba1e9 req-527eaee5-f2a3-43c1-b578-9cfe0000f86e tempest-VolumesGetTestJSON-1706018710 None] Created volume successfully. Jul 10 07:55:22 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa" returned: 1 in 1.173s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_igls6vsa' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f49db-7d25-4bff-822a-2ba5bfdb737d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:22 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD Jul 10 07:55:22 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Acquiring lock "cinder-c96fe189-4089-45f5-87c6-2c44d5ee4c03-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "cinder-c96fe189-4089-45f5-87c6-2c44d5ee4c03-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:22 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Acquiring lock "cinder-quobyte-c96fe189-4089-45f5-87c6-2c44d5ee4c03" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "cinder-quobyte-c96fe189-4089-45f5-87c6-2c44d5ee4c03" acquired by "delete_volume" :: waited 0.059s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:22 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:22 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874a9c1-adba-42be-97b9-78491824adf1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:23 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 Jul 10 07:55:23 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:23 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:23 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03 Jul 10 07:55:23 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:24 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c96fe189-4089-45f5-87c6-2c44d5ee4c03" returned: 0 in 1.046s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "cinder-quobyte-c96fe189-4089-45f5-87c6-2c44d5ee4c03" released by "delete_volume" :: held 2.023s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG cinder.quota [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Created reservations ['61faf298-af25-4c45-ad7a-5e232ca12954', '78a1c38e-14ec-41e3-b999-27fa1edaf54a', '9e077a36-acbf-4ef8-82d1-2fa99500cf29', '00257dac-4e37-4198-835d-3af4637d65f6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:25 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:25 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:25 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 0 in 2.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_mjfmox39devstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:55:25 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Converted 112.00 MB image at 40.90 MB/s Jul 10 07:55:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:25 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1G Jul 10 07:55:25 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:26 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.105s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG cinder.manager [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Deleted volume successfully. Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-616b78cb-20e5-400a-bc2f-870d7a26e0e1 req-4d4bcc24-f808-4736-b8fb-d79b5df53bff tempest-VolumesGetTestJSON-1706018710 None] Lock "cinder-c96fe189-4089-45f5-87c6-2c44d5ee4c03-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:26 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf 1G" returned: 0 in 1.071s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f674a2a-57b8-4ee9-b4a6-4b4fae5b7963]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:26 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:26 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:27 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 0 in 1.200s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:28 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:28 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:29 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 1 in 1.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Downloaded image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 for user f131e6215f86480aa07b6b6886d667d8 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Marking volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Copying metadata from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 to b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:55:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Creating volume glance metadata for volume b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf backed by image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:55:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed156fdc-b992-403c-ad40-e29f7550d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8696623-0627-4f17-b3fa-da17c1881695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Volume volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf (b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf): created successfully Jul 10 07:55:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8696623-0627-4f17-b3fa-da17c1881695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Flow 'volume_create_manager' (a01eb0bc-2354-4ae2-a598-e05d62091c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-17bb081f-841e-465f-bda6-7ead1baa4f78 tempest-VolumesImageMetadata-1342153423 None] Created volume successfully. Jul 10 07:55:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Acquiring lock "cinder-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "cinder-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Acquiring lock "cinder-quobyte-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "cinder-quobyte-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4cf2785-6ade-43e2-89b1-008a768d1650 tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-1329196027: creating Jul 10 07:55:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4cf2785-6ade-43e2-89b1-008a768d1650 tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-1329196027: created successfully Jul 10 07:55:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e94df-77a4-49d9-bda5-bcfb988a97d6]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4cf2785-6ade-43e2-89b1-008a768d1650 tempest-GroupSnapshotsTest-1931988402 None] Create group completed successfully. Jul 10 07:55:32 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:32 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:33 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 0 in 1.304s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:33 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:33 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (323bb92f-4d5b-4fef-8c58-63c47d8cbf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85290a0-7eaa-4147-b59f-46d72418faf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85290a0-7eaa-4147-b59f-46d72418faf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960375476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d962573-233a-4e05-9f2a-fd514c7d8a1a,host='devstack@QuobyteHD#QuobyteHD',id=cc5ad282-a1d4-4a19-890b-3982fcb270e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:34Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07296e70-db5e-4010-8ade-15d35251adb5),volume_type_id=07296e70-db5e-4010-8ade-15d35251adb5)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64d41c-f2e8-4e44-bbac-1442d899a7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64d41c-f2e8-4e44-bbac-1442d899a7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af6e106-302c-4085-a1b8-efb60a03bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af6e106-302c-4085-a1b8-efb60a03bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5ad282-a1d4-4a19-890b-3982fcb270e2', 'volume_name': 'volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787b328a-45c6-4676-a849-86cf3b5d258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787b328a-45c6-4676-a849-86cf3b5d258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e530756d-b3b4-45ce-8a52-1d46b154edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Volume cc5ad282-a1d4-4a19-890b-3982fcb270e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2', 'volume_size': 1} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d962573-233a-4e05-9f2a-fd514c7d8a1a,created_at=2026-07-10T05:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960375476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d962573-233a-4e05-9f2a-fd514c7d8a1a,host='devstack@QuobyteHD#QuobyteHD',id=cc5ad282-a1d4-4a19-890b-3982fcb270e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:34Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07296e70-db5e-4010-8ade-15d35251adb5),volume_type_id=07296e70-db5e-4010-8ade-15d35251adb5)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Creating volume cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:34 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:34 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 1073741824 Jul 10 07:55:34 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:35 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 1 in 1.533s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:55:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:35 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf Jul 10 07:55:35 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:36 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 1073741824" returned: 0 in 1.512s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:36 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" returned: 0 in 1.322s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "cinder-quobyte-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf" released by "delete_volume" :: held 4.336s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:36 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:55:36 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:36 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:36 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Created reservations ['4b2910f3-5a47-41a9-bc13-adfe65be6076', 'fe514741-4735-4942-a240-68f826a5970e', 'b6c0257c-c4ed-40aa-8420-34e1d02cbfc8', '32ef9111-6a3c-4282-8c2a-c3390ad774b8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:36 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:36 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:37 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 1.223s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] <== create_volume: return (2812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e530756d-b3b4-45ce-8a52-1d46b154edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1e055-7b12-403a-9f33-dd2edcfa610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Volume volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 (cc5ad282-a1d4-4a19-890b-3982fcb270e2): created successfully Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1e055-7b12-403a-9f33-dd2edcfa610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (323bb92f-4d5b-4fef-8c58-63c47d8cbf3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-df74d737-c2c5-477a-81e5-166e688f5f4c tempest-GroupSnapshotsTest-1931988402 None] Created volume successfully. Jul 10 07:55:37 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.563s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:55:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:55:38 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.334s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Deleted volume successfully. Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-36d28322-7ad4-4bad-a05a-7b0b95273b0a tempest-VolumesImageMetadata-1342153423 None] Lock "cinder-b46cb3dd-2ddd-4e64-86e1-e5d78f49f5bf-delete_volume" released by "delete_volume" :: held 6.200s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] GroupSnapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: creating. Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Group snapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Creating offline snapshot d62a0b64-b66a-438f-8d90-1b44fb9e2c34 of volume cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:55:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f6c0a-bf01-48ec-b462-8ea81c721ffb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:39 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:55:39 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:40 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 1.184s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:40 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 1G Jul 10 07:55:40 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:41 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 1G" returned: 0 in 0.917s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:41 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:55:41 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:41 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:55:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:41 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:55:41 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:42 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=108,cinder:INSERT=46,cinder:UPDATE=137,cinder:DELETE=9 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:55:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=141,cinder:DELETE=13 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:55:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:42 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info Jul 10 07:55:42 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:43 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:43 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:43 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info Jul 10 07:55:43 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Flow 'volume_create_manager' (a023e69a-10eb-4c14-96c2-f9d6b4b27e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32778c8-ba72-40a2-b118-f857b1cc67ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32778c8-ba72-40a2-b118-f857b1cc67ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-322925837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a50580c-e8d7-4370-8f45-3f1822eed727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac39e94c8f4b5e84e8e67d1676e3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:43Z,use_quota=True,user_id='a8697de4ad344dbdac7ba6a49517f4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f002a4e-5be4-4a96-b2da-266b7a2d4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f002a4e-5be4-4a96-b2da-266b7a2d4c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0af2c95-8203-4e66-83fa-cbe7cfe9d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0af2c95-8203-4e66-83fa-cbe7cfe9d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a50580c-e8d7-4370-8f45-3f1822eed727', 'volume_name': 'volume-2a50580c-e8d7-4370-8f45-3f1822eed727', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c76578-4f8f-4782-b1f5-0896e329e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c76578-4f8f-4782-b1f5-0896e329e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0d7469-2061-44a5-9f8e-718fdd3f1d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Volume 2a50580c-e8d7-4370-8f45-3f1822eed727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a50580c-e8d7-4370-8f45-3f1822eed727', 'volume_size': 1} Jul 10 07:55:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:44 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.info" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.201s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-322925837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a50580c-e8d7-4370-8f45-3f1822eed727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac39e94c8f4b5e84e8e67d1676e3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:43Z,use_quota=True,user_id='a8697de4ad344dbdac7ba6a49517f4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Creating volume 2a50580c-e8d7-4370-8f45-3f1822eed727 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:44 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 1073741824 Jul 10 07:55:44 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bd7f0650-a32b-4791-9371-a1ed5c2baf18 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: created successfully Jul 10 07:55:45 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 1073741824" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:45 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 Jul 10 07:55:45 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:45 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0d7469-2061-44a5-9f8e-718fdd3f1d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a50580c-e8d7-4370-8f45-3f1822eed727', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007fb434-8f18-4dda-b468-4a3895c7f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Volume volume-2a50580c-e8d7-4370-8f45-3f1822eed727 (2a50580c-e8d7-4370-8f45-3f1822eed727): created successfully Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007fb434-8f18-4dda-b468-4a3895c7f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Flow 'volume_create_manager' (a023e69a-10eb-4c14-96c2-f9d6b4b27e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7ddc06c1-f72e-41e6-83e7-abb0b42905fb tempest-VolumesTransfersTest-1856375600 None] Created volume successfully. Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34-9d043b37-64ac-42f2-9160-75c82fc8d195" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34-9d043b37-64ac-42f2-9160-75c82fc8d195" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Creating volume 9d043b37-64ac-42f2-9160-75c82fc8d195 from snapshot d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] snapshot: d62a0b64-b66a-438f-8d90-1b44fb9e2c34, volume: 9d043b37-64ac-42f2-9160-75c82fc8d195, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c84d856-ede0-4d7f-9ba4-97474ea30f67]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:46 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:55:46 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:47 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 1.347s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad82a61-eeaa-4d7b-ae45-36e468e0d5b5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3639fef4-517d-4235-be90-c903820e3de1 tempest-VolumesTransfersTest-166969737 None] Transfer volume completed successfully. Jul 10 07:55:48 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:55:48 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:48 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:48 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:55:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:48 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 Jul 10 07:55:48 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Acquiring lock "cinder-2a50580c-e8d7-4370-8f45-3f1822eed727-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "cinder-2a50580c-e8d7-4370-8f45-3f1822eed727-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Acquiring lock "cinder-quobyte-2a50580c-e8d7-4370-8f45-3f1822eed727" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "cinder-quobyte-2a50580c-e8d7-4370-8f45-3f1822eed727" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16efdbf-03f5-45bf-ac90-ec76bd90129a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:49 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 Jul 10 07:55:49 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:51 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727" returned: 0 in 1.614s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:51 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727 Jul 10 07:55:51 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:52 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-2a50580c-e8d7-4370-8f45-3f1822eed727" returned: 0 in 1.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "cinder-quobyte-2a50580c-e8d7-4370-8f45-3f1822eed727" released by "delete_volume" :: held 3.551s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Created reservations ['e15eaa10-7259-44cf-9bdd-9e1ed002eabb', 'cb86ff50-3fe7-4f52-b4bc-a0a7db433f3b', '28f30006-fd96-4749-90d6-8fc04604a41e', 'e9a319ee-4ba4-4731-80f3-b5f19cb4a11e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:53 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:55:53 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:54 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.517s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:55:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Deleted volume successfully. Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9197528-8165-4e97-8716-efb1938a43c5 tempest-VolumesTransfersTest-203448975 None] Lock "cinder-2a50580c-e8d7-4370-8f45-3f1822eed727-delete_volume" released by "delete_volume" :: held 5.652s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:55 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195" returned: 0 in 6.523s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72aa61a-635b-4dda-950c-57447949634a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Flow 'volume_create_manager' (0760c7cc-ccce-4a00-8c66-b3caba07131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d41dec6-f8fe-4efe-ac68-1657af83ffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d41dec6-f8fe-4efe-ac68-1657af83ffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1341023404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bca301-e6d3-4e54-a7d9-06a26e475d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a6d353be9944c78aa39fa94a549b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:55Z,use_quota=True,user_id='9fc810b06c554abd8948f3180bb1838e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23135506-73b4-4568-901c-4fbf73cf7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23135506-73b4-4568-901c-4fbf73cf7b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109ec00-9252-4cb1-b2fe-61c1890a4896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:55:55 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:55:55 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Flow 'volume_create_manager' (77731d57-d4b0-4bc9-b110-fd64760f0d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f91708-5a37-4404-8ad5-096b6b7561c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f91708-5a37-4404-8ad5-096b6b7561c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1247768543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29091fa6-a4ee-4014-819f-03853b42bcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac39e94c8f4b5e84e8e67d1676e3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:56Z,use_quota=True,user_id='a8697de4ad344dbdac7ba6a49517f4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2329e6f-4581-4e37-a60c-b795ce82604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2329e6f-4581-4e37-a60c-b795ce82604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f3ab04-8b51-4e45-b0f1-fbf9631980af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f3ab04-8b51-4e45-b0f1-fbf9631980af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29091fa6-a4ee-4014-819f-03853b42bcf4', 'volume_name': 'volume-29091fa6-a4ee-4014-819f-03853b42bcf4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356bfcab-67e2-4c95-b267-bbb0f1d5dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356bfcab-67e2-4c95-b267-bbb0f1d5dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b5f4f0-7d60-477b-bc89-0908446b1c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Volume 29091fa6-a4ee-4014-819f-03853b42bcf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29091fa6-a4ee-4014-819f-03853b42bcf4', 'volume_size': 1} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109ec00-9252-4cb1-b2fe-61c1890a4896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83bca301-e6d3-4e54-a7d9-06a26e475d68', 'volume_name': 'volume-83bca301-e6d3-4e54-a7d9-06a26e475d68', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b981ff-8012-4846-95f7-1e467a1b14a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b981ff-8012-4846-95f7-1e467a1b14a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db0e2f-003a-439f-b42a-c3a32c92b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Volume 83bca301-e6d3-4e54-a7d9-06a26e475d68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83bca301-e6d3-4e54-a7d9-06a26e475d68', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Trying to clone 83bca301-e6d3-4e54-a7d9-06a26e475d68 from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:55:56 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Image download 20.69 MB at 20.69 MB/s Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab779a2-b90d-40ee-a84d-f025ee97c1ba]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:56 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD Jul 10 07:55:56 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:56 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 1.047s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:55:56 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Converted 1024.00 MB image at 156.92 MB/s Jul 10 07:55:56 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:55:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:56 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 Jul 10 07:55:56 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:57 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 is fetched for user 9fc810b06c554abd8948f3180bb1838e. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5195d7-ad9c-4246-a5f5-c0435f6ce512]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:57 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" released by "_copy_volume_from_snapshot" :: held 10.743s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34-9d043b37-64ac-42f2-9160-75c82fc8d195" released by "_create_volume_from_snapshot" :: held 10.783s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.807s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.837s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14f7f2-5918-4fd6-9231-4774b704e55e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:57 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD Jul 10 07:55:57 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0febe7f3-a665-4ed6-8aa9-af1f29bea92a tempest-GroupSnapshotsTest-1931988402 None] Create group from source-snapshot-362992be-4ce6-4c86-ba22-0d15522b3bdc completed successfully. Jul 10 07:55:57 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:55:57 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:57 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:58 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1247768543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29091fa6-a4ee-4014-819f-03853b42bcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ac39e94c8f4b5e84e8e67d1676e3b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:56Z,use_quota=True,user_id='a8697de4ad344dbdac7ba6a49517f4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Creating volume 29091fa6-a4ee-4014-819f-03853b42bcf4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:58 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 1073741824 Jul 10 07:55:58 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-9b1a3fa1-c515-4526-ac93-b476b01eb915', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83db49a5-5f98-4dcb-b100-5888b94dc40a', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:55:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-0f881559-4a39-40e2-b660-ef850f43dff5 req-516c26e0-98a0-4c72-b8f1-d7ed81a7cce5 tempest-TestStampPattern-480241403 None] attachment_update completed successfully. Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010f45d-ac1a-46fa-a6d8-84e1c244dd7f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:58 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 Jul 10 07:55:58 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:58 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 1073741824" returned: 0 in 0.895s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:59 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 Jul 10 07:55:59 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:59 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:59 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195 Jul 10 07:55:59 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:59 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4" returned: 0 in 0.714s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1341023404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bca301-e6d3-4e54-a7d9-06a26e475d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a6d353be9944c78aa39fa94a549b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:55:55Z,use_quota=True,user_id='9fc810b06c554abd8948f3180bb1838e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Creating volume 83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:55:59 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b5f4f0-7d60-477b-bc89-0908446b1c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29091fa6-a4ee-4014-819f-03853b42bcf4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:59 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1073741824 Jul 10 07:55:59 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed0965f-72b2-4fe6-8e8f-cf93e6fb2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:55:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Volume volume-29091fa6-a4ee-4014-819f-03853b42bcf4 (29091fa6-a4ee-4014-819f-03853b42bcf4): created successfully Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed0965f-72b2-4fe6-8e8f-cf93e6fb2f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:55:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Flow 'volume_create_manager' (77731d57-d4b0-4bc9-b110-fd64760f0d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:55:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-53e4f678-46ec-440b-b3c3-d7ddca4bc0f1 tempest-VolumesTransfersTest-1856375600 None] Created volume successfully. Jul 10 07:56:00 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9d043b37-64ac-42f2-9160-75c82fc8d195" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-9d043b37-64ac-42f2-9160-75c82fc8d195" released by "delete_volume" :: held 1.643s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['343659f1-89e4-47ce-a01e-a72f97205776'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:00 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1488010654 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1488010654, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:56:00 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1488010654 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1488010654, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['ffe59e9e-4328-4c89-9ada-d7f01d0321c1', '8f8a016d-c0e9-4ac5-bf84-200cbb6cac32', '05b31fa7-91b7-4dad-9a9f-8886fcb1c56d', '0571b198-f36d-4c25-93e0-208dadead45d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:00 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:00 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Acquiring lock "cinder-29091fa6-a4ee-4014-819f-03853b42bcf4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "cinder-29091fa6-a4ee-4014-819f-03853b42bcf4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Acquiring lock "cinder-quobyte-29091fa6-a4ee-4014-819f-03853b42bcf4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "cinder-quobyte-29091fa6-a4ee-4014-819f-03853b42bcf4" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:00 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1073741824" returned: 0 in 1.010s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6182385d-672f-4109-ade9-55626f3095e2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:00 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:00 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:00 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 Jul 10 07:56:00 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: deleting Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Deleting offline snapshot d62a0b64-b66a-438f-8d90-1b44fb9e2c34 of volume cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] snapshot_file for this snap is: volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e2114-3f5b-49dc-b981-99ca7469ae02]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:01 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:01 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.160s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:01 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d8d725ad-6b1a-4ac6-992a-045dc83558c2 tempest-GroupSnapshotsTest-1931988402 None] Delete group completed successfully. Jul 10 07:56:01 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:01 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Attempting download of 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 83bca301-e6d3-4e54-a7d9-06a26e475d68. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[39877b5a-b993-462d-bb92-d145c6137229]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:02 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4" returned: 0 in 1.348s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:02 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4 Jul 10 07:56:02 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:02 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0 Jul 10 07:56:02 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:02 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e26491-d7d9-408a-bf8a-46b2e7cebcaa]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:02 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:56:02 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:03 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0" returned: 0 in 0.949s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:03 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-29091fa6-a4ee-4014-819f-03853b42bcf4" returned: 0 in 0.927s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "cinder-quobyte-29091fa6-a4ee-4014-819f-03853b42bcf4" released by "delete_volume" :: held 2.356s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Created reservations ['1b74fbdd-b768-4630-a59c-516c55c5bc99', '90814284-a19c-4c79-aa2d-188288833a88', '8b8e6b9b-80ed-4b5c-a733-b550a9d5184a', 'b1443dee-f785-4745-9b75-2eebb6f15f54'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:03 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0 Jul 10 07:56:03 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:03 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:03 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:03 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:03 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:56:03 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:03 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0" returned: 1 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_n9_dfix0' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7759a17-1528-4f8e-9ffe-ca6fa8e5b307]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:04 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.828s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Deleted volume successfully. Jul 10 07:56:04 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD Jul 10 07:56:04 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aa63428-77ef-434a-8cbf-a4109c2ee36f tempest-VolumesTransfersTest-203448975 None] Lock "cinder-29091fa6-a4ee-4014-819f-03853b42bcf4-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:04 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:04 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34 Jul 10 07:56:04 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:04 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:56:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:04 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:04 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:05 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2.d62a0b64-b66a-438f-8d90-1b44fb9e2c34" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-d62a0b64-b66a-438f-8d90-1b44fb9e2c34" released by "_delete_snapshot" :: held 3.926s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" released by "delete_snapshot" :: held 3.968s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:05 devstack cinder-volume[87192]: WARNING cinder.quota [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1488010654 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1488010654, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['9c8c8d1b-92be-46af-93dc-aa6899e02594', 'b579891a-3257-4fb4-8131-d324111a6b7b', 'c91b4a6e-d643-4c16-a52a-28df0e1bd820', 'b34de40e-c621-46c5-8c6e-deb193bc79fc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f8e06cf4-5ad8-4e53-8a4e-cae5732bf977 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 362992be-4ce6-4c86-ba22-0d15522b3bdc: deleted successfully Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc25a41-a161-4330-82b5-692ea4e6c1e1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:06 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:56:06 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-e3c7c674-3cae-47b8-a8f2-0194df9d9702 req-f1afdacb-2126-4e23-9fa3-f3b74d980939 tempest-TestStampPattern-480241403 None] Terminate volume connection completed successfully. Jul 10 07:56:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-e3c7c674-3cae-47b8-a8f2-0194df9d9702 req-f1afdacb-2126-4e23-9fa3-f3b74d980939 tempest-TestStampPattern-480241403 None] Deleting attachment 83db49a5-5f98-4dcb-b100-5888b94dc40a. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:56:07 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 1.100s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:07 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2 Jul 10 07:56:07 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:07 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 2.482s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_7oqhcqjadevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:56:07 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Converted 112.00 MB image at 45.09 MB/s Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:07 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1G Jul 10 07:56:07 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:07 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cc5ad282-a1d4-4a19-890b-3982fcb270e2" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-cc5ad282-a1d4-4a19-890b-3982fcb270e2" released by "delete_volume" :: held 2.024s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['b8036203-51bf-4d87-b248-4b9af9ed6a48'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:08 devstack cinder-volume[87192]: WARNING cinder.db.api [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1488010654'] Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['127c245f-ff71-40a7-add0-e7fd3ba21de6', '742e4965-3ff7-421f-8b1e-c2ef3bbdb709', '961c2e3b-df76-4d0e-9a82-c7f2a3d1b079', '4852f3fd-c1c4-4d5b-87dd-0e58c7ba1a7c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:08 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 1G" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1587cbb6-ed4c-4081-a2ec-9efa923846b5]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:08 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:08 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:08 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:08 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-68301881-2099-4cca-b458-1be524ec22f7 tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-1217515151: creating Jul 10 07:56:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-68301881-2099-4cca-b458-1be524ec22f7 tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-1217515151: created successfully Jul 10 07:56:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-68301881-2099-4cca-b458-1be524ec22f7 tempest-GroupSnapshotsTest-1931988402 None] Create group completed successfully. Jul 10 07:56:09 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-07d88dc8-b94d-440d-9a98-f3912793a080 tempest-GroupSnapshotsTest-1931988402 None] Delete group completed successfully. Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Creating offline snapshot 5e59e327-a05e-45cd-9fe7-e17c403a8939 of volume 9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5531370-f64f-4a98-988c-1148b361f98a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:09 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 1.102s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:09 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:56:09 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:09 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:09 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:10 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:10 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 1G Jul 10 07:56:10 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:10 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 1 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Downloaded image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 83bca301-e6d3-4e54-a7d9-06a26e475d68 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 for user 9fc810b06c554abd8948f3180bb1838e is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Marking volume 83bca301-e6d3-4e54-a7d9-06a26e475d68 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Copying metadata from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 to 83bca301-e6d3-4e54-a7d9-06a26e475d68. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Creating volume glance metadata for volume 83bca301-e6d3-4e54-a7d9-06a26e475d68 backed by image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47db0e2f-003a-439f-b42a-c3a32c92b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bca301-e6d3-4e54-a7d9-06a26e475d68', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ee78c-c75b-45ff-96cd-c441a6ceb798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Volume volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 (83bca301-e6d3-4e54-a7d9-06a26e475d68): created successfully Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ee78c-c75b-45ff-96cd-c441a6ceb798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Flow 'volume_create_manager' (0760c7cc-ccce-4a00-8c66-b3caba07131d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7d07fc69-1bf2-449f-a2ff-19272c9554cc tempest-TestShelveInstance-1719096134 None] Created volume successfully. Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (a70954ff-f1c3-4bae-9995-0cd953c95237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b1d035-67e8-41a0-80c2-1b9c3e08b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b1d035-67e8-41a0-80c2-1b9c3e08b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127439829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,host='devstack@QuobyteHD#QuobyteHD',id=bb8d50af-055e-4894-a38c-52c3c7c9a607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:11Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2754c2-cfea-4455-a3b1-27998bb21981),volume_type_id=ed2754c2-cfea-4455-a3b1-27998bb21981)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c3168-d20b-44f6-b29f-55be6788f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c3168-d20b-44f6-b29f-55be6788f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21974838-3340-44d1-8208-f1b69ae63ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21974838-3340-44d1-8208-f1b69ae63ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8d50af-055e-4894-a38c-52c3c7c9a607', 'volume_name': 'volume-bb8d50af-055e-4894-a38c-52c3c7c9a607', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01319d7b-3838-4f4d-b582-e507e38de6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01319d7b-3838-4f4d-b582-e507e38de6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2522e3-e855-499f-927a-3ebb9e54e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Volume bb8d50af-055e-4894-a38c-52c3c7c9a607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8d50af-055e-4894-a38c-52c3c7c9a607', 'volume_size': 1} Jul 10 07:56:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:11 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 1G" returned: 0 in 0.965s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:11 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:56:11 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:11 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 is being set with open permissions: ugo+rw Jul 10 07:56:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:11 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:56:11 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Flow 'volume_create_manager' (ac468db2-832f-4048-bfd0-ad4f9c3fb057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:12 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea455f8-2a17-47af-a0c0-1b4777b1031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea455f8-2a17-47af-a0c0-1b4777b1031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1374532960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0ae7d693234a58a44e689c33a7e599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:12Z,use_quota=True,user_id='cc176e95da7340079ce99633058ff818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616efcac-f38a-4b2d-82f0-fe59d0c916b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616efcac-f38a-4b2d-82f0-fe59d0c916b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daea200-7f74-4463-a583-9bb28ae201ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daea200-7f74-4463-a583-9bb28ae201ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1', 'volume_name': 'volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ef4607-6957-4feb-b709-6be94f46cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ef4607-6957-4feb-b709-6be94f46cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3247fa1-e6e5-4ccb-a2a5-38df00ff9c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Volume cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1', 'volume_size': 1} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:12 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info Jul 10 07:56:12 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:13 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info" returned: 0 in 0.662s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info is being set with open permissions: ugo+rw Jul 10 07:56:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:13 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info Jul 10 07:56:13 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:13 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.info" returned: 0 in 0.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.224s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,created_at=2026-07-10T05:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127439829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,host='devstack@QuobyteHD#QuobyteHD',id=bb8d50af-055e-4894-a38c-52c3c7c9a607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:11Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2754c2-cfea-4455-a3b1-27998bb21981),volume_type_id=ed2754c2-cfea-4455-a3b1-27998bb21981)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Creating volume bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:14 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:14 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 1073741824 Jul 10 07:56:14 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b5ba5539-8343-43bc-986b-541e9a991932 tempest-TestStampPattern-480241403 None] Create snapshot completed successfully Jul 10 07:56:14 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 1073741824" returned: 0 in 0.881s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:14 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 Jul 10 07:56:14 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:15 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1374532960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0ae7d693234a58a44e689c33a7e599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:12Z,use_quota=True,user_id='cc176e95da7340079ce99633058ff818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Creating volume cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:15 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2522e3-e855-499f-927a-3ebb9e54e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8d50af-055e-4894-a38c-52c3c7c9a607', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:15 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 1073741824 Jul 10 07:56:15 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e8e420-a16c-4ba4-8f6d-ff839f893b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Volume volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 (bb8d50af-055e-4894-a38c-52c3c7c9a607): created successfully Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e8e420-a16c-4ba4-8f6d-ff839f893b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (a70954ff-f1c3-4bae-9995-0cd953c95237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dbced4e8-342d-4aeb-bb27-9e99201aaafd tempest-GroupSnapshotsTest-1931988402 None] Created volume successfully. Jul 10 07:56:16 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 1073741824" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:16 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 Jul 10 07:56:16 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (81d2dfeb-5ba5-44d7-bdde-9ce5593c2738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1c06c7-7ce4-4598-8858-e50e30312608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1c06c7-7ce4-4598-8858-e50e30312608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036100419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,host='devstack@QuobyteHD#QuobyteHD',id=b79ac10d-a254-405e-be87-5002fe8606ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:17Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2754c2-cfea-4455-a3b1-27998bb21981),volume_type_id=ed2754c2-cfea-4455-a3b1-27998bb21981)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d4da6-ab8a-4500-9fc1-70582f7d6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d4da6-ab8a-4500-9fc1-70582f7d6d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205aea0-4e59-4139-9ef5-16ecfe1f61db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205aea0-4e59-4139-9ef5-16ecfe1f61db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79ac10d-a254-405e-be87-5002fe8606ee', 'volume_name': 'volume-b79ac10d-a254-405e-be87-5002fe8606ee', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fba3c8-0da3-46d0-9ab6-67c3b9d09a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fba3c8-0da3-46d0-9ab6-67c3b9d09a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6506d423-207a-41e6-bf81-80109c3fb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Volume b79ac10d-a254-405e-be87-5002fe8606ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79ac10d-a254-405e-be87-5002fe8606ee', 'volume_size': 1} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:17 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,created_at=2026-07-10T05:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036100419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3f0fffa-a905-4674-a76e-d1a760f8e91a,host='devstack@QuobyteHD#QuobyteHD',id=b79ac10d-a254-405e-be87-5002fe8606ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:17Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2754c2-cfea-4455-a3b1-27998bb21981),volume_type_id=ed2754c2-cfea-4455-a3b1-27998bb21981)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Creating volume b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:17 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3247fa1-e6e5-4ccb-a2a5-38df00ff9c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee 1073741824 Jul 10 07:56:17 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4a49b8-59bb-47bf-992b-dfd52d38f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:17 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Volume volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 (cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1): created successfully Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4a49b8-59bb-47bf-992b-dfd52d38f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Flow 'volume_create_manager' (ac468db2-832f-4048-bfd0-ad4f9c3fb057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a5521c2a-30c9-44fa-b135-e32e1fe95635 tempest-VolumesTransfersV355Test-1521588812 None] Created volume successfully. Jul 10 07:56:18 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee 1073741824" returned: 0 in 1.136s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:18 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee Jul 10 07:56:18 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-116f37a7-e6fa-466a-8b4f-5a82b9041ff2 tempest-VolumesTransfersV355Test-2057963723 None] Transfer volume completed successfully. Jul 10 07:56:19 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.721s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6506d423-207a-41e6-bf81-80109c3fb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79ac10d-a254-405e-be87-5002fe8606ee', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803c868-99ea-4b26-95e5-aba03c2222f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Volume volume-b79ac10d-a254-405e-be87-5002fe8606ee (b79ac10d-a254-405e-be87-5002fe8606ee): created successfully Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803c868-99ea-4b26-95e5-aba03c2222f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (81d2dfeb-5ba5-44d7-bdde-9ce5593c2738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf035c4-d1d0-4993-a842-af3e9899e8e1]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7fec66c4-179e-4c68-af8e-e282d2811cf2 tempest-GroupSnapshotsTest-1931988402 None] Created volume successfully. Jul 10 07:56:19 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:19 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c8b6f94c-6b8b-41dd-8a79-1994fbdcd7b3 tempest-GroupSnapshotsTest-1931988402 None] Update group completed successfully. Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "cinder-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "cinder-quobyte-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-quobyte-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bfecb-9ac8-4616-b185-2e5a59eba98e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:20 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 0.909s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:20 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 Jul 10 07:56:20 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:20 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:56:20 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:21 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:21 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1 Jul 10 07:56:21 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-496374b0-792f-409c-9b6d-b14dee7c004b tempest-GroupSnapshotsTest-1931988402 None] Update group completed successfully. Jul 10 07:56:21 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 1 in 0.947s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.917s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-83bca301-e6d3-4e54-a7d9-06a26e475d68', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0bf8009-f5a6-4011-a473-d27c1ca11ff4', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:56:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-d62c0c14-85d6-4d1d-b54c-32a17ddc9954 req-de0d897d-4b99-44d7-8a87-0f80ba5bd80a tempest-TestShelveInstance-1719096134 None] attachment_update completed successfully. Jul 10 07:56:21 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" returned: 0 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-quobyte-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1" released by "delete_volume" :: held 1.722s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Created reservations ['b9bde38d-4b43-4f05-8a15-14e7cf8ffa66', '15fca694-3b23-4b2e-bc2f-0fe20cc3153f', '5b7a4033-03ca-4e68-99bf-23c34739c952', 'a08bd925-20e7-4b5f-a263-f62870b6a2ed'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:22 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:22 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-deec67f3-543a-4be3-b8a0-5f2af256425d tempest-GroupSnapshotsTest-1931988402 None] Update group completed successfully. Jul 10 07:56:22 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.709s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Deleted volume successfully. Jul 10 07:56:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b539f236-fdec-48b4-b0f7-cd646a60cfe3 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-cbdf36ab-3ee3-4be1-83d5-0077bf11bdb1-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Flow 'volume_create_manager' (8eb03c38-2faa-4ec0-9229-f98059820188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1314b1-f7ca-41f6-b07e-808b13107a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1314b1-f7ca-41f6-b07e-808b13107a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810259505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6fc43-f07b-4d8e-b087-f5c6621b3ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0ae7d693234a58a44e689c33a7e599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:23Z,use_quota=True,user_id='cc176e95da7340079ce99633058ff818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb743b-5906-4605-8bea-32e7102fde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb743b-5906-4605-8bea-32e7102fde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc8ba69-1f5f-4c85-9c2d-d92ee418fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc8ba69-1f5f-4c85-9c2d-d92ee418fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f6fc43-f07b-4d8e-b087-f5c6621b3ef0', 'volume_name': 'volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224ff7b0-55f3-4c48-829b-835f8740ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224ff7b0-55f3-4c48-829b-835f8740ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5253ed44-a0f4-4277-a070-790964a31406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Volume 86f6fc43-f07b-4d8e-b087-f5c6621b3ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0', 'volume_size': 1} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810259505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6fc43-f07b-4d8e-b087-f5c6621b3ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0ae7d693234a58a44e689c33a7e599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:23Z,use_quota=True,user_id='cc176e95da7340079ce99633058ff818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Creating volume 86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:23 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:23 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 1073741824 Jul 10 07:56:23 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-35ebb627-4391-44d6-9098-909e033ef9a9 tempest-GroupSnapshotsTest-1931988402 None] Update group completed successfully. Jul 10 07:56:24 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 1073741824" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:24 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 Jul 10 07:56:24 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:25 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5253ed44-a0f4-4277-a070-790964a31406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3372aa6b-ea79-449a-bfcb-38c0a95d6aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Volume volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 (86f6fc43-f07b-4d8e-b087-f5c6621b3ef0): created successfully Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3372aa6b-ea79-449a-bfcb-38c0a95d6aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Flow 'volume_create_manager' (8eb03c38-2faa-4ec0-9229-f98059820188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-81b1fa4c-352e-4f97-8694-630258523ed6 tempest-VolumesTransfersV355Test-1521588812 None] Created volume successfully. Jul 10 07:56:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] GroupSnapshot 8c6fa3f6-1832-4706-b072-f7345386208b: creating. Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Group snapshot 8c6fa3f6-1832-4706-b072-f7345386208b: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Creating offline snapshot 08e9062f-39e4-4d3d-a719-f89358439440 of volume bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0f29a-eadf-4641-9502-33e2cb2594a6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Flow 'volume_create_manager' (3b80bc9a-70b9-4075-adec-e2b4fcd11d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414d7ce6-d689-45b5-9cb6-1a8e02ccc1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414d7ce6-d689-45b5-9cb6-1a8e02ccc1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-758867649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd03618b-7483-4816-b450-248ebb056b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7b07e20c8c46a8b54dbcb2f392ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e59e327-a05e-45cd-9fe7-e17c403a8939,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:26Z,use_quota=True,user_id='2a3d050414f045958ef24d86d1d7c114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f274162-b21a-4f7a-986e-d70a1b3b4b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f274162-b21a-4f7a-986e-d70a1b3b4b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dcfb54-b42f-4d0d-ab14-21427d955d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dcfb54-b42f-4d0d-ab14-21427d955d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd03618b-7483-4816-b450-248ebb056b38', 'volume_name': 'volume-cd03618b-7483-4816-b450-248ebb056b38', 'volume_size': 1, 'snapshot_id': '5e59e327-a05e-45cd-9fe7-e17c403a8939'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0820835f-cca1-49ff-bfd0-259d22c35649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0820835f-cca1-49ff-bfd0-259d22c35649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:26 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 Jul 10 07:56:26 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177bc9c-efd3-48f7-b57f-8f25c1d9adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Volume cd03618b-7483-4816-b450-248ebb056b38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd03618b-7483-4816-b450-248ebb056b38', 'volume_size': 1, 'snapshot_id': '5e59e327-a05e-45cd-9fe7-e17c403a8939'} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "cinder-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "cinder-quobyte-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-quobyte-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[481cde60-7f4f-4040-832e-fa42b57dd741]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:26 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 Jul 10 07:56:26 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:26 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607" returned: 0 in 1.036s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:26 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 1G Jul 10 07:56:26 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:27 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" returned: 0 in 1.108s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:27 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0 Jul 10 07:56:27 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:27 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 1G" returned: 0 in 1.068s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:27 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 Jul 10 07:56:27 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:28 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-quobyte-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0" released by "delete_volume" :: held 2.146s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Created reservations ['e8722505-2f9c-4139-8724-7ffaae928035', 'a65bcac6-6f6d-429d-857d-55dc0f36c9c3', '4e5b5f8d-bb1e-4c07-b305-f6a909a3044e', '2cf88cdb-b3e4-402d-87c4-18ffe5af7a46'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:28 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:28 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:29 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440" returned: 0 in 1.136s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:29 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:29 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 Jul 10 07:56:29 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:29 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Deleted volume successfully. Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9e4d207a-6ea0-4d85-92e5-5400916be542 tempest-VolumesTransfersV355Test-762408368 None] Lock "cinder-86f6fc43-f07b-4d8e-b087-f5c6621b3ef0-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:29 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440" returned: 0 in 0.919s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:30 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info Jul 10 07:56:30 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:31 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info" returned: 0 in 1.152s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:31 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:56:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:31 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info Jul 10 07:56:31 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:32 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.info" returned: 0 in 1.355s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.871s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Creating offline snapshot 7ed7167c-a491-4106-bde7-9ccce3e41111 of volume b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da8044-4295-4754-bced-7490d4e80ec9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:32 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee Jul 10 07:56:32 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:33 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee" returned: 0 in 1.187s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:33 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 1G Jul 10 07:56:33 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:35 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 1G" returned: 0 in 1.565s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ac10d-a254-405e-be87-5002fe8606ee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:35 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ac10d-a254-405e-be87-5002fe8606ee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 Jul 10 07:56:35 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:36 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:56:36 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:36 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79ac10d-a254-405e-be87-5002fe8606ee -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111" returned: 0 in 1.360s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:56:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:36 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 Jul 10 07:56:36 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:37 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.161s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:56:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:56:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:56:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:56:38 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111" returned: 0 in 1.564s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:38 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info Jul 10 07:56:38 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:39 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info" returned: 0 in 1.108s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:39 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:56:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:39 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info Jul 10 07:56:39 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:40 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.info" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.628s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.159s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939-cd03618b-7483-4816-b450-248ebb056b38" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939-cd03618b-7483-4816-b450-248ebb056b38" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Creating volume cd03618b-7483-4816-b450-248ebb056b38 from snapshot 5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] snapshot: 5e59e327-a05e-45cd-9fe7-e17c403a8939, volume: cd03618b-7483-4816-b450-248ebb056b38, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a526739-b1d9-4b3b-8d1b-db550b7b1822]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-32d8a62a-dfc6-4155-8520-874c9fd02e17 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 8c6fa3f6-1832-4706-b072-f7345386208b: created successfully Jul 10 07:56:40 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:56:40 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 8c6fa3f6-1832-4706-b072-f7345386208b: deleting Jul 10 07:56:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 8c6fa3f6-1832-4706-b072-f7345386208b: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-08e9062f-39e4-4d3d-a719-f89358439440" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-08e9062f-39e4-4d3d-a719-f89358439440" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Deleting offline snapshot 08e9062f-39e4-4d3d-a719-f89358439440 of volume bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] snapshot_file for this snap is: volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9006985f-ac32-4575-aaa4-59904d9397c3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:41 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 Jul 10 07:56:41 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (fe53af4d-b4ff-4141-b18b-6f2a49775d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d02a49-dd55-4317-8fe5-2d85ef2b1cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d02a49-dd55-4317-8fe5-2d85ef2b1cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1638979879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05adbf93-0642-442f-aa33-712c7817947d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:41Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f9b2ce-0094-4c05-8192-ba2d1cf074bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f9b2ce-0094-4c05-8192-ba2d1cf074bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e43cc6c-40e9-4864-a4d8-648259e687c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e43cc6c-40e9-4864-a4d8-648259e687c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05adbf93-0642-442f-aa33-712c7817947d', 'volume_name': 'volume-05adbf93-0642-442f-aa33-712c7817947d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df7c60b-df43-45bf-bc28-a35ac20d1b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df7c60b-df43-45bf-bc28-a35ac20d1b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b9500-361c-4833-8419-0a808d3c4642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Volume 05adbf93-0642-442f-aa33-712c7817947d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05adbf93-0642-442f-aa33-712c7817947d', 'volume_size': 1} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:41 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 1.240s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b1a3fa1-c515-4526-ac93-b476b01eb915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ea6ac-77e1-4093-a485-cb7fa09fff48]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:41 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:56:41 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:42 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440" returned: 0 in 1.499s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb8d50af-055e-4894-a38c-52c3c7c9a607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:56:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6454ecb-defb-487f-b384-335240666cfc]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:42 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 Jul 10 07:56:42 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:42 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 1.279s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:43 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:56:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:43 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 Jul 10 07:56:43 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:43 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607" returned: 0 in 1.030s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:43 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 Jul 10 07:56:43 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:45 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440" returned: 0 in 1.508s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:45 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440 Jul 10 07:56:45 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:48 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607.08e9062f-39e4-4d3d-a719-f89358439440" returned: 0 in 2.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-08e9062f-39e4-4d3d-a719-f89358439440" released by "_delete_snapshot" :: held 7.005s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" released by "delete_snapshot" :: held 7.068s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=111,cinder:UPDATE=98,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-7ed7167c-a491-4106-bde7-9ccce3e41111" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-7ed7167c-a491-4106-bde7-9ccce3e41111" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Deleting offline snapshot 7ed7167c-a491-4106-bde7-9ccce3e41111 of volume b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] snapshot_file for this snap is: volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a52a38-a36c-483e-ad55-e37e743fa083]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:48 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 Jul 10 07:56:48 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111" returned: 0 in 2.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b79ac10d-a254-405e-be87-5002fe8606ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:56:51 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5694ec-2e34-4436-be6b-615e8b88c7d7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:51 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38" returned: 0 in 8.421s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4526b-e544-4ea1-89c1-72550c4a97c6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:51 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=114,cinder:INSERT=25,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:56:51 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee Jul 10 07:56:51 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:51 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:56:51 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:52 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee" returned: 0 in 1.630s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:53 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 Jul 10 07:56:53 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:53 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 1.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:53 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:56:53 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Converted 1024.00 MB image at 121.55 MB/s Jul 10 07:56:53 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 is being set with open permissions: ugo+rw Jul 10 07:56:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:53 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 Jul 10 07:56:53 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:54 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38" returned: 0 in 0.956s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" released by "_copy_volume_from_snapshot" :: held 13.773s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939-cd03618b-7483-4816-b450-248ebb056b38" released by "_create_volume_from_snapshot" :: held 13.836s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.878s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.519s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1638979879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05adbf93-0642-442f-aa33-712c7817947d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:41Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Creating volume 05adbf93-0642-442f-aa33-712c7817947d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:54 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:54 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d 1073741824 Jul 10 07:56:54 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1177bc9c-efd3-48f7-b57f-8f25c1d9adc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd03618b-7483-4816-b450-248ebb056b38', 'volume_size': 1, 'snapshot_id': '5e59e327-a05e-45cd-9fe7-e17c403a8939'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c79e83-1b9c-49d0-8619-5ae2906c8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Volume volume-cd03618b-7483-4816-b450-248ebb056b38 (cd03618b-7483-4816-b450-248ebb056b38): created successfully Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c79e83-1b9c-49d0-8619-5ae2906c8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Flow 'volume_create_manager' (3b80bc9a-70b9-4075-adec-e2b4fcd11d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03e571d5-3af9-4bcc-97f2-296c7bf61682 tempest-TestStampPattern-480241403 None] Created volume successfully. Jul 10 07:56:54 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111" returned: 0 in 1.517s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:54 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111 Jul 10 07:56:54 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:55 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d 1073741824" returned: 0 in 1.348s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:55 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee.7ed7167c-a491-4106-bde7-9ccce3e41111" returned: 0 in 1.039s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-7ed7167c-a491-4106-bde7-9ccce3e41111" released by "_delete_snapshot" :: held 7.152s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" released by "delete_snapshot" :: held 7.243s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:55 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d Jul 10 07:56:55 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:55 devstack cinder-volume[87192]: WARNING cinder.quota [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1050457433 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1050457433, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:56:55 devstack cinder-volume[87192]: WARNING cinder.quota [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1050457433 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1050457433, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['bfadd387-916c-4ddd-9906-0f5018f2e988', '35816a2b-f366-4b56-a986-f200c0b3cca8', '3706fc69-c0fe-45f2-8d94-b71c771c47c5', 'ceb9b064-e662-4517-a61a-3399ba3c2e3b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['e3a2ccfa-8b96-4058-80b7-542a11f7ae89', '282a89d3-f426-47fd-8ce8-dc8fd2671506', 'e01fba0e-e46d-4c80-95e6-b1f5bea2a898', 'cb513bc4-f7e9-4ebb-811f-a392f81382e8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:56:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0c726104-9ba9-4705-968c-9dcb668fcb59 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 8c6fa3f6-1832-4706-b072-f7345386208b: deleted successfully Jul 10 07:56:56 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b9500-361c-4833-8419-0a808d3c4642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05adbf93-0642-442f-aa33-712c7817947d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfecc83-83a3-400f-8659-a95be8cc2853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Volume volume-05adbf93-0642-442f-aa33-712c7817947d (05adbf93-0642-442f-aa33-712c7817947d): created successfully Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfecc83-83a3-400f-8659-a95be8cc2853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (fe53af4d-b4ff-4141-b18b-6f2a49775d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d50572ca-508c-459c-a438-313fb1e02077 tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14650d9-91ee-49e3-9c2e-fe3634d5e0b1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:57 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee Jul 10 07:56:57 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (07f85aeb-51c4-4049-890b-e479dc9ae1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24fec8-424a-4ff8-bb5f-b8b5eac73d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24fec8-424a-4ff8-bb5f-b8b5eac73d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406422880',display_name='tempest-VolumesGetTest-Volume-1912344088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac056da2-8df2-495b-b098-0b28ee30c664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:57Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c48f4c7-a5da-42de-9186-7fe72676dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c48f4c7-a5da-42de-9186-7fe72676dc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8977318-0fbb-4101-8561-fd518f58255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8977318-0fbb-4101-8561-fd518f58255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac056da2-8df2-495b-b098-0b28ee30c664', 'volume_name': 'volume-ac056da2-8df2-495b-b098-0b28ee30c664', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90b4e5-d1a3-4174-aa84-12f9ac0e8d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90b4e5-d1a3-4174-aa84-12f9ac0e8d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8952c476-433e-4178-85d6-4c4806966dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Volume ac056da2-8df2-495b-b098-0b28ee30c664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac056da2-8df2-495b-b098-0b28ee30c664', 'volume_size': 1} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:56:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406422880',display_name='tempest-VolumesGetTest-Volume-1912344088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac056da2-8df2-495b-b098-0b28ee30c664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:56:57Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Creating volume ac056da2-8df2-495b-b098-0b28ee30c664 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:56:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:56:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:57 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 1073741824 Jul 10 07:56:57 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:58 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee" returned: 0 in 0.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:58 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee Jul 10 07:56:58 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:58 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 1073741824" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:58 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 Jul 10 07:56:58 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:59 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b79ac10d-a254-405e-be87-5002fe8606ee" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-b79ac10d-a254-405e-be87-5002fe8606ee" released by "delete_volume" :: held 1.751s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1492d-aa1a-4d9f-aa57-bf4204e2dba3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:56:59 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 Jul 10 07:56:59 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:56:59 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664" returned: 0 in 0.694s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8952c476-433e-4178-85d6-4c4806966dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac056da2-8df2-495b-b098-0b28ee30c664', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd93ebd3-0b53-4832-a4c9-a0ee4281fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:56:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Volume volume-ac056da2-8df2-495b-b098-0b28ee30c664 (ac056da2-8df2-495b-b098-0b28ee30c664): created successfully Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd93ebd3-0b53-4832-a4c9-a0ee4281fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (07f85aeb-51c4-4049-890b-e479dc9ae1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:56:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-83522a0d-ad6c-42bb-a74f-85fbbdc2acb6 tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-ac056da2-8df2-495b-b098-0b28ee30c664-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "cinder-ac056da2-8df2-495b-b098-0b28ee30c664-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-ac056da2-8df2-495b-b098-0b28ee30c664" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:56:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-ac056da2-8df2-495b-b098-0b28ee30c664" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:00 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2781cb8d-368f-4c2e-b0dc-185ef9c3d71f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607" returned: 0 in 0.943s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:00 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607 Jul 10 07:57:00 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:00 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 Jul 10 07:57:00 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:00 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb8d50af-055e-4894-a38c-52c3c7c9a607" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-bb8d50af-055e-4894-a38c-52c3c7c9a607" released by "delete_volume" :: held 1.920s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:00 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664" returned: 0 in 0.987s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:01 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664 Jul 10 07:57:01 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['923cee20-ff10-4cc0-96aa-cbf7c9e5614c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:01 devstack cinder-volume[87192]: WARNING cinder.quota [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1050457433 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1050457433, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['a9ab79ef-9e9e-4f7d-af92-41e72781a25c', 'f3c25252-586e-4e42-a9a1-52c8063dbaa2', '6ee4cedf-3e2f-4307-a508-1e269ca5673d', '62a157af-f915-4e80-9b83-d9a9310e9cc7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['21138f94-b715-4193-a707-d2572bf303a4', '47bb4bc7-3f7c-4772-80b4-4a85f825a015', '8c35d93c-714d-4c8b-b712-7814ea7cd8cf', '1a5d8232-e45a-4799-94f7-e6543b2c6c02'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:01 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:01 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ce3fd5f7-3a5c-4a7e-8390-c6aa5c41c141 req-84f3589d-7a9c-4a5f-b8ea-95d31aa4b500 tempest-TestShelveInstance-1719096134 None] Terminate volume connection completed successfully. Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ce3fd5f7-3a5c-4a7e-8390-c6aa5c41c141 req-84f3589d-7a9c-4a5f-b8ea-95d31aa4b500 tempest-TestShelveInstance-1719096134 None] Deleting attachment d0bf8009-f5a6-4011-a473-d27c1ca11ff4. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:57:01 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ac056da2-8df2-495b-b098-0b28ee30c664" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-ac056da2-8df2-495b-b098-0b28ee30c664" released by "delete_volume" :: held 1.864s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Created reservations ['d97ea68f-2000-4aa0-bef9-7fefa396498d', '9c712107-1908-4a9d-9bdf-288231660fbc', '4da55def-6fe2-49a2-95fd-b8b7678935af', 'b1ba9b3b-94d1-4e8e-b209-c1c92889fa43'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:02 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:02 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:02 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9a51c1f2-edff-41fd-bb4c-08e2c8a4fee8 tempest-GroupSnapshotsTest-1931988402 None] Delete group completed successfully. Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-05adbf93-0642-442f-aa33-712c7817947d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "cinder-05adbf93-0642-442f-aa33-712c7817947d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-05adbf93-0642-442f-aa33-712c7817947d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-05adbf93-0642-442f-aa33-712c7817947d" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf789864-ed8a-414f-871b-a2f254df2bc8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:02 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d Jul 10 07:57:02 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e8ec786b-cce9-4ca1-b32c-506329093b0b tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-2132983113: creating Jul 10 07:57:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e8ec786b-cce9-4ca1-b32c-506329093b0b tempest-GroupSnapshotsTest-1931988402 None] Group tempest-GroupSnapshotsTest-Group-2132983113: created successfully Jul 10 07:57:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e8ec786b-cce9-4ca1-b32c-506329093b0b tempest-GroupSnapshotsTest-1931988402 None] Create group completed successfully. Jul 10 07:57:03 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.010s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:57:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-808ed6a6-6375-4ce7-80a7-9a1a74062c35 tempest-VolumesGetTest-623022283 None] Lock "cinder-ac056da2-8df2-495b-b098-0b28ee30c664-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:03 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d" returned: 0 in 0.985s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:03 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d Jul 10 07:57:03 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:04 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05adbf93-0642-442f-aa33-712c7817947d" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-05adbf93-0642-442f-aa33-712c7817947d" released by "delete_volume" :: held 1.804s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Created reservations ['c393a7bc-1b3d-4638-a9e6-68303dfac7c5', '528fc1e7-342f-491c-ab22-156d9416b522', 'ad00c8e4-26da-4c45-aeec-2e3567700b54', '6ccc3800-6aa2-487e-96e8-81010c0e27e6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (3a6535f8-7543-4641-b9e8-e436c7dc0cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1659b3c-f7ee-488a-a131-3d0a60aa34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1659b3c-f7ee-488a-a131-3d0a60aa34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047417173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8f26726-1103-4f29-97d7-5b5e9bba3b00,host='devstack@QuobyteHD#QuobyteHD',id=0ad36886-5d53-433d-b29f-a0507d378f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:04Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a51d764-b1bc-4564-a491-c57f86b33e7f),volume_type_id=9a51d764-b1bc-4564-a491-c57f86b33e7f)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa1249a-f25c-4a7d-b959-2062cf9c73b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa1249a-f25c-4a7d-b959-2062cf9c73b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7799455-426c-441d-b356-d2188539ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7799455-426c-441d-b356-d2188539ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad36886-5d53-433d-b29f-a0507d378f2c', 'volume_name': 'volume-0ad36886-5d53-433d-b29f-a0507d378f2c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd5ddf1-c541-4d5d-bc8d-f445ed7f7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd5ddf1-c541-4d5d-bc8d-f445ed7f7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdf7b05-20c6-40e4-bb96-3d25cf84b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Volume 0ad36886-5d53-433d-b29f-a0507d378f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad36886-5d53-433d-b29f-a0507d378f2c', 'volume_size': 1} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8f26726-1103-4f29-97d7-5b5e9bba3b00,created_at=2026-07-10T05:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047417173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8f26726-1103-4f29-97d7-5b5e9bba3b00,host='devstack@QuobyteHD#QuobyteHD',id=0ad36886-5d53-433d-b29f-a0507d378f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff27b6ba46a4fbbb1c3ffc8e636a71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:04Z,use_quota=True,user_id='5d013ca513d248a0a26579f8aff9275a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a51d764-b1bc-4564-a491-c57f86b33e7f),volume_type_id=9a51d764-b1bc-4564-a491-c57f86b33e7f)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Creating volume 0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:57:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:04 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c 1073741824 Jul 10 07:57:04 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:04 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:04 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (ac8992af-75a1-4399-a822-2081fab81aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384efd6f-4c3a-4968-9361-193a7199e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384efd6f-4c3a-4968-9361-193a7199e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650438213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c50991-c34a-4fa1-bbe4-06791f830166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:05Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d29e257-5878-4f53-81ec-ef5927cbc2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d29e257-5878-4f53-81ec-ef5927cbc2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aea95ba-a3d9-4512-a300-07450b73b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aea95ba-a3d9-4512-a300-07450b73b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c50991-c34a-4fa1-bbe4-06791f830166', 'volume_name': 'volume-e1c50991-c34a-4fa1-bbe4-06791f830166', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd86fc44-3a87-4cf4-8eb7-dcc8d634b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd86fc44-3a87-4cf4-8eb7-dcc8d634b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b06abaf-8c73-4616-91d8-c9005b59f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Volume e1c50991-c34a-4fa1-bbe4-06791f830166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c50991-c34a-4fa1-bbe4-06791f830166', 'volume_size': 1} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:05 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ca82126-05ac-4282-8f11-a66ede9e519a tempest-VolumesGetTest-623022283 None] Lock "cinder-05adbf93-0642-442f-aa33-712c7817947d-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:05 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c 1073741824" returned: 0 in 1.148s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:05 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c Jul 10 07:57:05 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:06 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650438213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c50991-c34a-4fa1-bbe4-06791f830166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:05Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Creating volume e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:57:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdf7b05-20c6-40e4-bb96-3d25cf84b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad36886-5d53-433d-b29f-a0507d378f2c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:06 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 1073741824 Jul 10 07:57:06 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8527ac-465e-4fcb-a9d8-5fd13dfccebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Volume volume-0ad36886-5d53-433d-b29f-a0507d378f2c (0ad36886-5d53-433d-b29f-a0507d378f2c): created successfully Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8527ac-465e-4fcb-a9d8-5fd13dfccebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Flow 'volume_create_manager' (3a6535f8-7543-4641-b9e8-e436c7dc0cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b3148bc6-e08c-4a94-8e50-6002ac568b23 tempest-GroupSnapshotsTest-1931988402 None] Created volume successfully. Jul 10 07:57:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] GroupSnapshot 4f3af88f-98cc-4444-8d6a-330938113441: creating. Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Group snapshot 4f3af88f-98cc-4444-8d6a-330938113441: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 07:57:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:07 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 1073741824" returned: 0 in 0.894s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:07 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:07 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:07 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.979s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Creating offline snapshot db157202-aa20-4109-9853-a268e26393dd of volume 0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b06abaf-8c73-4616-91d8-c9005b59f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c50991-c34a-4fa1-bbe4-06791f830166', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94df070-de25-4c0f-a3a4-248ab5d59c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd6a7b-7e42-49bc-b9f8-20ff6ceaa3f8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Volume volume-e1c50991-c34a-4fa1-bbe4-06791f830166 (e1c50991-c34a-4fa1-bbe4-06791f830166): created successfully Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94df070-de25-4c0f-a3a4-248ab5d59c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (ac8992af-75a1-4399-a822-2081fab81aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-68dd5d39-9c2d-456e-b6da-a8263cb99148 tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:57:08 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c Jul 10 07:57:08 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:08 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:08 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd 1G Jul 10 07:57:08 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (fe3911f5-cc9a-40f4-b603-8f0926b9d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7aeb19-c7df-4ef9-a26d-e16b747d5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7aeb19-c7df-4ef9-a26d-e16b747d5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-930267411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531e0721-637b-40d1-be98-0d860e01bd56,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e1c50991-c34a-4fa1-bbe4-06791f830166,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:09Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe39a87-94a4-47b8-8f15-3b93b778a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe39a87-94a4-47b8-8f15-3b93b778a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e64b50-6a63-4170-bb3e-17b6730b9d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e64b50-6a63-4170-bb3e-17b6730b9d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '531e0721-637b-40d1-be98-0d860e01bd56', 'volume_name': 'volume-531e0721-637b-40d1-be98-0d860e01bd56', 'volume_size': 1, 'source_volid': 'e1c50991-c34a-4fa1-bbe4-06791f830166', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5bc56-2fb3-4c19-bfa3-ee2c4e567e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5bc56-2fb3-4c19-bfa3-ee2c4e567e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e2f0b0-89a4-4be1-beeb-0da100af182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Volume 531e0721-637b-40d1-be98-0d860e01bd56: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-531e0721-637b-40d1-be98-0d860e01bd56', 'volume_size': 1, 'source_volid': 'e1c50991-c34a-4fa1-bbe4-06791f830166', 'source_volstatus': 'available'} Jul 10 07:57:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:09 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd 1G" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad36886-5d53-433d-b29f-a0507d378f2c -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:09 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad36886-5d53-433d-b29f-a0507d378f2c -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd Jul 10 07:57:09 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:10 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad36886-5d53-433d-b29f-a0507d378f2c -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd" returned: 0 in 0.714s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:10 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:57:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:10 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd Jul 10 07:57:10 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:10 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:11 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info Jul 10 07:57:11 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:11 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:57:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:11 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info Jul 10 07:57:11 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:12 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.info" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.706s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a3d5f-846b-4eae-84d0-9f44593ade9a]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-20c7c1a3-d70e-4333-9225-9ea39464e4b5 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 4f3af88f-98cc-4444-8d6a-330938113441: created successfully Jul 10 07:57:12 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:57:12 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:13 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:13 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:57:13 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 4f3af88f-98cc-4444-8d6a-330938113441: deleting Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 4f3af88f-98cc-4444-8d6a-330938113441: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-db157202-aa20-4109-9853-a268e26393dd" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-db157202-aa20-4109-9853-a268e26393dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Deleting offline snapshot db157202-aa20-4109-9853-a268e26393dd of volume 0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] snapshot_file for this snap is: volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4266a1b-3da5-49d5-a7e6-dec1ed5a68ad]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:13 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd Jul 10 07:57:13 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:13 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 1 in 0.858s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.641s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.029s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Cloning volume e1c50991-c34a-4fa1-bbe4-06791f830166 to volume 531e0721-637b-40d1-be98-0d860e01bd56 Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Creating offline snapshot 637cfabc-8c90-4b4f-9a9b-1729633dfb0d of volume e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-83bca301-e6d3-4e54-a7d9-06a26e475d68', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60e6a3a5-abd3-4259-9c71-5cc29e574f78', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d8689c-2c19-4829-94fc-c8ff4740501a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-fd0b604e-84fa-4d2c-b7e7-d35085c40078 req-ba8c6c4e-8c2a-4324-9ccc-d6316f85f8a6 tempest-TestShelveInstance-1719096134 None] attachment_update completed successfully. Jul 10 07:57:14 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:14 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:14 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd" returned: 0 in 0.826s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad36886-5d53-433d-b29f-a0507d378f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e2267-470f-4a36-8569-13cc9bd9d0e6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:14 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c Jul 10 07:57:14 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:14 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:14 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d 1G Jul 10 07:57:14 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:15 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:15 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd Jul 10 07:57:15 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:15 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d 1G" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c50991-c34a-4fa1-bbe4-06791f830166 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:15 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c50991-c34a-4fa1-bbe4-06791f830166 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:15 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:16 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd" returned: 0 in 0.840s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:16 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd Jul 10 07:57:16 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:16 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1c50991-c34a-4fa1-bbe4-06791f830166 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.781s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:16 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d is being set with open permissions: ugo+rw Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:16 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:16 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:16 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c.db157202-aa20-4109-9853-a268e26393dd" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-db157202-aa20-4109-9853-a268e26393dd" released by "_delete_snapshot" :: held 3.344s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" released by "delete_snapshot" :: held 3.375s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:17 devstack cinder-volume[87192]: WARNING cinder.quota [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-639818626 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-639818626, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:17 devstack cinder-volume[87192]: WARNING cinder.quota [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-639818626 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-639818626, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['c91cd7ce-69a3-4029-a7db-5751e5e8466d', 'fb37c339-589e-416d-8edb-0e68ead8bf85', '362b84ac-356f-479a-bc25-37865574dc2d', '9a4c9e22-7cdf-4e8e-a3f3-0b168766436a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c421d571-90bd-4730-837b-4556f2aa89e9 tempest-GroupSnapshotsTest-1931988402 None] group_snapshot 4f3af88f-98cc-4444-8d6a-330938113441: deleted successfully Jul 10 07:57:17 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:17 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info Jul 10 07:57:17 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:17 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:17 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info is being set with open permissions: ugo+rw Jul 10 07:57:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:17 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info Jul 10 07:57:17 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be8afec-0d98-48a9-9cf7-4bd0e94b975e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:18 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c Jul 10 07:57:18 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:18 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.info" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] snapshot: 637cfabc-8c90-4b4f-9a9b-1729633dfb0d, volume: 531e0721-637b-40d1-be98-0d860e01bd56, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e9b1d-56a5-442e-a64e-2bfe3418c183]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:18 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:18 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:19 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:19 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c Jul 10 07:57:19 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:19 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1c50991-c34a-4fa1-bbe4-06791f830166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d75f11-83d9-4c4b-a784-3bae94559528]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:19 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:19 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:20 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0ad36886-5d53-433d-b29f-a0507d378f2c" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Lock "cinder-quobyte-0ad36886-5d53-433d-b29f-a0507d378f2c" released by "delete_volume" :: held 1.712s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['b84646c1-97e4-481e-ba5f-9ec76b0df669'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:20 devstack cinder-volume[87192]: WARNING cinder.quota [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-639818626 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-639818626, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Created reservations ['a114d4d9-6a53-4a2a-8a43-340c59d3e089', '224a9b62-75ce-4fe3-97b3-4002fde36a4b', 'aa4b36da-a0d5-4e62-9480-2c3a706d6ccd', '1b4e576d-8294-4d03-a898-630b8159ab2f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:20 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:20 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:20 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:57:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:20 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 Jul 10 07:57:20 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:21 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:21 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dd6cb6d3-0040-4f38-90a4-17df25de7e93 tempest-GroupSnapshotsTest-1931988402 None] Delete group completed successfully. Jul 10 07:57:27 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56" returned: 0 in 6.899s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a95737-d8b6-4ce8-95fd-197227ab8c25]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:27 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:27 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:28 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 1.116s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:28 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:57:28 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Converted 1024.00 MB image at 148.40 MB/s Jul 10 07:57:28 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 is being set with open permissions: ugo+rw Jul 10 07:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:28 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 Jul 10 07:57:28 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:29 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" released by "_copy_volume_from_snapshot" :: held 10.636s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-637cfabc-8c90-4b4f-9a9b-1729633dfb0d" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-637cfabc-8c90-4b4f-9a9b-1729633dfb0d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Deleting offline snapshot 637cfabc-8c90-4b4f-9a9b-1729633dfb0d of volume e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] snapshot_file for this snap is: volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcccfeb-ad69-4464-9d9a-c9b315d7bbdf]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:29 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:29 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:30 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=62,cinder:UPDATE=86,cinder:INSERT=24,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:57:30 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.978s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1c50991-c34a-4fa1-bbe4-06791f830166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:57:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142ab45-8ee3-45da-b7df-79ffe2d65c9f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fcdec2fb-7e5c-44f8-aa49-c94da148a7cb tempest-GroupSnapshotsV319Test-2015875800 None] Group tempest-GroupSnapshotsV319Test-Group-1779892093: creating Jul 10 07:57:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fcdec2fb-7e5c-44f8-aa49-c94da148a7cb tempest-GroupSnapshotsV319Test-2015875800 None] Group tempest-GroupSnapshotsV319Test-Group-1779892093: created successfully Jul 10 07:57:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fcdec2fb-7e5c-44f8-aa49-c94da148a7cb tempest-GroupSnapshotsV319Test-2015875800 None] Create group completed successfully. Jul 10 07:57:30 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:30 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:31 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:31 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:31 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Flow 'volume_create_manager' (947358fb-63c0-4481-96c1-c37ceec77c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bce9efb-828f-419a-8df0-d22830ad7149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bce9efb-828f-419a-8df0-d22830ad7149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918935519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=399207f3-14a8-493b-8067-af8ee976f11e,host='devstack@QuobyteHD#QuobyteHD',id=9ab18dd8-f307-4828-bef2-40b4e111e5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfbf050b8cc4c42816ee4b0808c779f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:32Z,use_quota=True,user_id='de02dc343cea437c8f152bbd76c7fb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab0801f7-93f2-45c4-ba2d-3dd1dc09cad0),volume_type_id=ab0801f7-93f2-45c4-ba2d-3dd1dc09cad0)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33809607-92b5-4f65-a8c7-3ec0ba0d384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33809607-92b5-4f65-a8c7-3ec0ba0d384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bdb6ba-52bd-462d-914c-ece1bd0324d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bdb6ba-52bd-462d-914c-ece1bd0324d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab18dd8-f307-4828-bef2-40b4e111e5b4', 'volume_name': 'volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a996f7-493d-46b6-aff8-7a67c5866e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a996f7-493d-46b6-aff8-7a67c5866e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafc230b-0831-414f-9f88-8fe4a036d5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Volume 9ab18dd8-f307-4828-bef2-40b4e111e5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4', 'volume_size': 1} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:32 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.989s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:32 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d Jul 10 07:57:32 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:32 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166.637cfabc-8c90-4b4f-9a9b-1729633dfb0d" returned: 0 in 0.652s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-637cfabc-8c90-4b4f-9a9b-1729633dfb0d" released by "_delete_snapshot" :: held 3.618s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.034s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.117s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e2f0b0-89a4-4be1-beeb-0da100af182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531e0721-637b-40d1-be98-0d860e01bd56', 'volume_size': 1, 'source_volid': 'e1c50991-c34a-4fa1-bbe4-06791f830166', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d0d636-1981-429d-86df-e4d58b78ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[212c7e1d-ca5c-4e29-b19a-85334df11bcd]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Volume volume-531e0721-637b-40d1-be98-0d860e01bd56 (531e0721-637b-40d1-be98-0d860e01bd56): created successfully Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d0d636-1981-429d-86df-e4d58b78ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (fe3911f5-cc9a-40f4-b603-8f0926b9d07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1fc703b3-98f5-42c1-b912-6f21b27847d3 tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:57:33 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 Jul 10 07:57:33 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:33 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=399207f3-14a8-493b-8067-af8ee976f11e,created_at=2026-07-10T05:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918935519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=399207f3-14a8-493b-8067-af8ee976f11e,host='devstack@QuobyteHD#QuobyteHD',id=9ab18dd8-f307-4828-bef2-40b4e111e5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfbf050b8cc4c42816ee4b0808c779f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:32Z,use_quota=True,user_id='de02dc343cea437c8f152bbd76c7fb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab0801f7-93f2-45c4-ba2d-3dd1dc09cad0),volume_type_id=ab0801f7-93f2-45c4-ba2d-3dd1dc09cad0)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Creating volume 9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:57:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:33 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 1073741824 Jul 10 07:57:33 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-cd03618b-7483-4816-b450-248ebb056b38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'defe966e-d0a2-4a99-9d7d-552a1a7b0662', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:57:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-703a298e-153d-48a7-9341-9fb564009ba5 req-59dcaeca-fab1-4ff4-a11d-10a35a6a7a43 tempest-TestStampPattern-480241403 None] attachment_update completed successfully. Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (062bb013-798a-4045-a530-32a0356a933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac6576-76b5-4f03-af62-d78897a86883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac6576-76b5-4f03-af62-d78897a86883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1689437223',display_name='tempest-VolumesGetTest-Volume-707577882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440b51c-2e1e-4b3e-8166-ceff2717359a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:34Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505eddf3-f4cd-4dde-931c-2262766596fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505eddf3-f4cd-4dde-931c-2262766596fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5aff73-c51a-4d59-94f3-43816f55798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5aff73-c51a-4d59-94f3-43816f55798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0440b51c-2e1e-4b3e-8166-ceff2717359a', 'volume_name': 'volume-0440b51c-2e1e-4b3e-8166-ceff2717359a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3570fd0-b2d5-4def-ae29-1c808a4c2b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3570fd0-b2d5-4def-ae29-1c808a4c2b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78656760-bd8d-4036-a32a-6453ffc5d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Volume 0440b51c-2e1e-4b3e-8166-ceff2717359a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0440b51c-2e1e-4b3e-8166-ceff2717359a', 'volume_size': 1} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:34 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 1073741824" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:34 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 Jul 10 07:57:34 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:35 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1689437223',display_name='tempest-VolumesGetTest-Volume-707577882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0440b51c-2e1e-4b3e-8166-ceff2717359a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:34Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Creating volume 0440b51c-2e1e-4b3e-8166-ceff2717359a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:57:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafc230b-0831-414f-9f88-8fe4a036d5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:35 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a 1073741824 Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e50f44c-b67f-4764-a506-0ed41328a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:35 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Volume volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 (9ab18dd8-f307-4828-bef2-40b4e111e5b4): created successfully Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e50f44c-b67f-4764-a506-0ed41328a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Flow 'volume_create_manager' (947358fb-63c0-4481-96c1-c37ceec77c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1be1690f-cca3-4675-a373-2fe381d3dd1c tempest-GroupSnapshotsV319Test-2015875800 None] Created volume successfully. Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:36 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:36 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:36 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a 1073741824" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:36 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a Jul 10 07:57:36 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:37 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:57:37 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78656760-bd8d-4036-a32a-6453ffc5d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0440b51c-2e1e-4b3e-8166-ceff2717359a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9affe71c-c71d-40ad-b017-696150f1c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Volume volume-0440b51c-2e1e-4b3e-8166-ceff2717359a (0440b51c-2e1e-4b3e-8166-ceff2717359a): created successfully Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9affe71c-c71d-40ad-b017-696150f1c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (062bb013-798a-4045-a530-32a0356a933b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] GroupSnapshot 49edadf3-3fd6-460a-832c-28bab013e051: creating. Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Group snapshot 49edadf3-3fd6-460a-832c-28bab013e051: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 07:57:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-42234a85-6bd0-4203-959c-00773d522e7a tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Creating offline snapshot b32a2f9c-4208-470b-a3df-06997b33ced1 of volume 9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[113375e3-e2e3-4b10-8ae0-c625c003b65e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:37 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 Jul 10 07:57:37 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:38 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:38 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 1G Jul 10 07:57:38 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-0440b51c-2e1e-4b3e-8166-ceff2717359a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "cinder-0440b51c-2e1e-4b3e-8166-ceff2717359a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-0440b51c-2e1e-4b3e-8166-ceff2717359a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-0440b51c-2e1e-4b3e-8166-ceff2717359a" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a75f6e6-6d8d-4194-9b79-7a3eccd661d7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:39 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a Jul 10 07:57:39 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:39 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 1G" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:39 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 Jul 10 07:57:39 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:39 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:39 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a Jul 10 07:57:39 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:40 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:40 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:40 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 Jul 10 07:57:40 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:40 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0440b51c-2e1e-4b3e-8166-ceff2717359a" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-0440b51c-2e1e-4b3e-8166-ceff2717359a" released by "delete_volume" :: held 1.719s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Created reservations ['d5356da2-d721-4df2-86c2-4087b1967efd', 'db0b7940-9623-47b0-bab6-6ef864eed6fc', 'ec167bce-2f2e-48e5-ba4b-284c76c7c097', 'd16879ec-8235-4b95-95e5-e8c70405a6ec'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:40 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:40 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:40 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:40 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info Jul 10 07:57:40 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-531e0721-637b-40d1-be98-0d860e01bd56-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "cinder-531e0721-637b-40d1-be98-0d860e01bd56-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd5978c-3b98-4667-8f51-a0d588f97b77]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:41 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 Jul 10 07:57:41 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-dc960793-a55e-4fef-ac34-9039566e7717 req-bf790183-218c-4ff3-9d35-729f9fa0dda8 tempest-TestStampPattern-480241403 None] Terminate volume connection completed successfully. Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-dc960793-a55e-4fef-ac34-9039566e7717 req-bf790183-218c-4ff3-9d35-729f9fa0dda8 tempest-TestStampPattern-480241403 None] Deleting attachment defe966e-d0a2-4a99-9d7d-552a1a7b0662. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:57:41 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.943s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-044f78c7-0414-4d28-8ef7-206237ccbbe5 tempest-VolumesGetTest-623022283 None] Lock "cinder-0440b51c-2e1e-4b3e-8166-ceff2717359a-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:41 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 07:57:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:41 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info Jul 10 07:57:41 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:42 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56" returned: 0 in 1.041s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:42 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56 Jul 10 07:57:42 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:42 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.info" returned: 0 in 0.711s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.251s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-79b99a47-c078-4016-a46f-d33dc0b5c0a2 tempest-GroupSnapshotsV319Test-2015875800 None] group_snapshot 49edadf3-3fd6-460a-832c-28bab013e051: created successfully Jul 10 07:57:43 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-531e0721-637b-40d1-be98-0d860e01bd56" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-531e0721-637b-40d1-be98-0d860e01bd56" released by "delete_volume" :: held 1.766s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Created reservations ['22dcc2c3-eda8-4a10-9506-f9181f03619c', '1628877a-51d5-4d0c-a1d4-be57944cf58e', '1f36d7d4-8b01-48da-a2d7-e58eb86403e8', '2f978134-4de8-4f54-bc26-01302599d740'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:43 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:43 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-e1c50991-c34a-4fa1-bbe4-06791f830166-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "cinder-e1c50991-c34a-4fa1-bbe4-06791f830166-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-e1c50991-c34a-4fa1-bbe4-06791f830166" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-e1c50991-c34a-4fa1-bbe4-06791f830166" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51cc91-e6f9-48d6-8bba-5961d9a0f6b6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:44 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:44 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:44 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-050c36ca-9899-42f1-b0a3-6790780944eb tempest-VolumesGetTest-623022283 None] Lock "cinder-531e0721-637b-40d1-be98-0d860e01bd56-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] group_snapshot 49edadf3-3fd6-460a-832c-28bab013e051: deleting Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] group_snapshot 49edadf3-3fd6-460a-832c-28bab013e051: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "cinder-quobyte-b32a2f9c-4208-470b-a3df-06997b33ced1" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-b32a2f9c-4208-470b-a3df-06997b33ced1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Deleting offline snapshot b32a2f9c-4208-470b-a3df-06997b33ced1 of volume 9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] snapshot_file for this snap is: volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ad96e-c795-4615-90a3-1218725666a0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:44 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 Jul 10 07:57:44 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:44 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:44 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166 Jul 10 07:57:44 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:45 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9565b0-9c87-4cf1-9a09-1041c1ab439b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:45 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 Jul 10 07:57:45 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:45 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e1c50991-c34a-4fa1-bbe4-06791f830166" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-e1c50991-c34a-4fa1-bbe4-06791f830166" released by "delete_volume" :: held 1.783s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Created reservations ['3a403ead-6581-4f43-95cc-8b7c9cfa748a', '15eaebec-d317-4257-8b47-61451fc45c83', '4ea642c0-68c5-4601-9e32-8e32a0dce325', '597aff6d-1b5b-49ba-8c01-7ddac41d28fb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:45 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:45 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:46 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4" returned: 0 in 0.913s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:46 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 Jul 10 07:57:46 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:46 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c25bc77e-46b2-4ac3-a4a4-c24bc1f0d70d tempest-VolumesGetTest-623022283 None] Lock "cinder-e1c50991-c34a-4fa1-bbe4-06791f830166-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (f307b208-6ece-40ce-b2ba-4bb8d8a4d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3ed98a-ef27-4efd-a4f5-342082ae5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3ed98a-ef27-4efd-a4f5-342082ae5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-54143230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7a2a0c-6aff-45ac-ab38-b29181af760e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:47Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1d0845-0c0f-475a-b5dc-f388db40897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1d0845-0c0f-475a-b5dc-f388db40897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173201e1-f484-480c-8c3f-f1aaccfd8ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:57:47 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1" returned: 0 in 1.058s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:47 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1 Jul 10 07:57:47 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173201e1-f484-480c-8c3f-f1aaccfd8ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a7a2a0c-6aff-45ac-ab38-b29181af760e', 'volume_name': 'volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42046ec2-2177-4780-9195-32ef4f79f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42046ec2-2177-4780-9195-32ef4f79f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9095542c-677a-4b44-90ed-f4705ef53438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Trying to clone 1a7a2a0c-6aff-45ac-ab38-b29181af760e from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:57:47 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:57:47 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Image download 20.69 MB at 20.69 MB/s Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90631e-e514-48d2-af36-7dd357f5ead8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:48 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD Jul 10 07:57:48 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:48 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4.b32a2f9c-4208-470b-a3df-06997b33ced1" returned: 0 in 0.859s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-b32a2f9c-4208-470b-a3df-06997b33ced1" released by "_delete_snapshot" :: held 3.859s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" released by "delete_snapshot" :: held 3.904s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:48 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-561096851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-561096851, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:48 devstack cinder-volume[87192]: WARNING cinder.quota [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-561096851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-561096851, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=130,cinder:UPDATE=118,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] Created reservations ['0442584a-59e1-4271-90eb-6291f9d5b4a6', '4ea93123-ab9b-4feb-a17e-585aff613c60', '158480cf-20db-46ba-b1f2-59116e5d6cd4', 'e9639487-3b07-4ec1-abe5-1283c79ca36a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d2c0e1e4-f646-4089-8817-ed08680880d5 tempest-GroupSnapshotsV319Test-2015875800 None] group_snapshot 49edadf3-3fd6-460a-832c-28bab013e051: deleted successfully Jul 10 07:57:48 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:48 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 is fetched for user 10a835a55482480697b40aa4cc2dcc84. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12b404-06d8-4c54-8a63-1e4fe4646f70]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:49 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD Jul 10 07:57:49 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d676c6f8-4068-4d66-9ebe-1226d210b52f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:49 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 Jul 10 07:57:49 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:49 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-54143230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7a2a0c-6aff-45ac-ab38-b29181af760e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:57:47Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Creating volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:57:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:57:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:50 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1073741824 Jul 10 07:57:50 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:50 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:50 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4 Jul 10 07:57:50 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:50 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1073741824" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:50 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ab18dd8-f307-4828-bef2-40b4e111e5b4" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:50 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:57:50 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Lock "cinder-quobyte-9ab18dd8-f307-4828-bef2-40b4e111e5b4" released by "delete_volume" :: held 1.743s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Created reservations ['feab5b98-e1f1-4e9b-a558-9d6e6f5c0557'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:51 devstack cinder-volume[87192]: WARNING cinder.quota [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-561096851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-561096851, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Created reservations ['0227936a-883c-43b6-a269-3dc7ba3269d5', 'bfbb308c-9b92-4c07-8290-6bc5017ec514', '69796ba1-acd2-4628-8c01-c6d1040257c9', 'd9897529-3e71-4576-9823-e9b4d8dd60c6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:51 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:51 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:51 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Attempting download of 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caff565-29aa-4ebc-94ee-7a47cb324fa6]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:51 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay Jul 10 07:57:51 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:51 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:51 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dc6b6ce5-51c8-4516-9108-89fb89152e1d tempest-GroupSnapshotsV319Test-2015875800 None] Delete group completed successfully. Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-cd03618b-7483-4816-b450-248ebb056b38-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "cinder-cd03618b-7483-4816-b450-248ebb056b38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[27942530-d7d0-40f6-a587-057d2a5c4b7c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:52 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 Jul 10 07:57:52 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:52 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:52 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay Jul 10 07:57:52 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:53 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:53 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38 Jul 10 07:57:53 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:53 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay" returned: 1 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_sb0k65ay' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e5061-ff0b-414c-8ce0-fc702155536c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:53 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD Jul 10 07:57:53 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:54 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cd03618b-7483-4816-b450-248ebb056b38" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-cd03618b-7483-4816-b450-248ebb056b38" released by "delete_volume" :: held 1.653s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Created reservations ['32185320-982b-485a-b327-2c60979ca472', 'e4d3dec4-67a5-491f-850c-3931731d660a', '33d603c8-5fec-4217-b81b-79197187b55c', '7e861687-65ac-44c2-84e4-8ab1cacf3d47'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:54 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:54 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:57:54 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:54 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:57:54 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-5e59e327-a05e-45cd-9fe7-e17c403a8939-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-5e59e327-a05e-45cd-9fe7-e17c403a8939-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Deleting offline snapshot 5e59e327-a05e-45cd-9fe7-e17c403a8939 of volume 9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] snapshot_file for this snap is: volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c92e4-bf1e-4e8e-827f-acbb2564b69b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:55 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:57:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Deleted volume successfully. Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd3a485-184f-4880-ad79-b5dc02763fd4 tempest-TestStampPattern-480241403 None] Lock "cinder-cd03618b-7483-4816-b450-248ebb056b38-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:55 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:57:55 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:55 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 0.888s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b1a3fa1-c515-4526-ac93-b476b01eb915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa016a9-6866-433a-a3f6-41430b64b60d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:56 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:57:56 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:56 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 0 in 2.391s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:56 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_28m1nk97devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:57:56 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Converted 112.00 MB image at 46.81 MB/s Jul 10 07:57:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:56 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1G Jul 10 07:57:56 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:56 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 0.840s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:56 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:57:56 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:57 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e 1G" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df5c2d-70d0-4c51-a0ef-597083286990]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:57:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:57 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:57:57 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:57 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:57 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939 Jul 10 07:57:57 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:58 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:57:58 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915.5e59e327-a05e-45cd-9fe7-e17c403a8939" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:58 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:57:58 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-5e59e327-a05e-45cd-9fe7-e17c403a8939" released by "_delete_snapshot" :: held 3.357s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" released by "delete_snapshot" :: held 3.385s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Created reservations ['38992b8b-7cf6-4306-ae1a-29ab6085b94b', '5e7f6018-8527-4673-8ac2-39ecb9d0263b', 'c83cfabe-c339-4a4f-b6df-107fd5725e8a', '3ea80815-a792-4941-813f-5ef5c20dd8d7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:57:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Delete snapshot completed successfully. Jul 10 07:57:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-966021f9-0ce5-4838-8234-0ed7a18d765c tempest-TestStampPattern-480241403 None] Lock "cinder-5e59e327-a05e-45cd-9fe7-e17c403a8939-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:57:59 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 1 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Downloaded image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 for user 10a835a55482480697b40aa4cc2dcc84 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Marking volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Copying metadata from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 to 1a7a2a0c-6aff-45ac-ab38-b29181af760e. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Creating volume glance metadata for volume 1a7a2a0c-6aff-45ac-ab38-b29181af760e backed by image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9095542c-677a-4b44-90ed-f4705ef53438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c862bdfc-e54d-407d-936b-325a8428c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:57:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Volume volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e (1a7a2a0c-6aff-45ac-ab38-b29181af760e): created successfully Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c862bdfc-e54d-407d-936b-325a8428c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:57:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (f307b208-6ece-40ce-b2ba-4bb8d8a4d49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:57:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b05f2a04-e14d-425b-a8c2-4e5ccdb50249 tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (2e703137-b161-493f-8cef-8d9ac2f0d1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dbe6dc-3ed6-4d6e-ba95-e56cac0a93c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dbe6dc-3ed6-4d6e-ba95-e56cac0a93c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-293259182',display_name='tempest-VolumesGetTest-Volume-805470706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9ced94-161c-44d7-b935-af8752eab194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:01Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40cd8b5-0fb1-480c-aee0-071b5ca8193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40cd8b5-0fb1-480c-aee0-071b5ca8193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a039074-58a7-44cf-a576-655b776de50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a039074-58a7-44cf-a576-655b776de50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9ced94-161c-44d7-b935-af8752eab194', 'volume_name': 'volume-1d9ced94-161c-44d7-b935-af8752eab194', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5e2d77-1942-469c-b759-f27b375bd54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5e2d77-1942-469c-b759-f27b375bd54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e419ee-ed04-46f0-bdf4-5634eecd360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Volume 1d9ced94-161c-44d7-b935-af8752eab194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9ced94-161c-44d7-b935-af8752eab194', 'volume_size': 1} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-293259182',display_name='tempest-VolumesGetTest-Volume-805470706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9ced94-161c-44d7-b935-af8752eab194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61c21dfbe634561909baca7b9000fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:01Z,use_quota=True,user_id='10a835a55482480697b40aa4cc2dcc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Creating volume 1d9ced94-161c-44d7-b935-af8752eab194 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:00 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 1073741824 Jul 10 07:58:00 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:01 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 1073741824" returned: 0 in 0.956s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:01 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 Jul 10 07:58:01 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:02 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e419ee-ed04-46f0-bdf4-5634eecd360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9ced94-161c-44d7-b935-af8752eab194', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4c866e-8bf3-49ff-9efe-2eb15ecc2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Volume volume-1d9ced94-161c-44d7-b935-af8752eab194 (1d9ced94-161c-44d7-b935-af8752eab194): created successfully Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4c866e-8bf3-49ff-9efe-2eb15ecc2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Flow 'volume_create_manager' (2e703137-b161-493f-8cef-8d9ac2f0d1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fbfb36ea-9565-48a7-95bd-784e937c491d tempest-VolumesGetTest-623022283 None] Created volume successfully. Jul 10 07:58:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eaa4a362-0bdc-464c-a010-24d2db3c7c38 tempest-GroupsV320Test-359674675 None] Group tempest-GroupsV320Test-Group-2125378075: creating Jul 10 07:58:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eaa4a362-0bdc-464c-a010-24d2db3c7c38 tempest-GroupsV320Test-359674675 None] Group tempest-GroupsV320Test-Group-2125378075: created successfully Jul 10 07:58:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eaa4a362-0bdc-464c-a010-24d2db3c7c38 tempest-GroupsV320Test-359674675 None] Create group completed successfully. Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-1d9ced94-161c-44d7-b935-af8752eab194-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "cinder-1d9ced94-161c-44d7-b935-af8752eab194-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-1d9ced94-161c-44d7-b935-af8752eab194" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-1d9ced94-161c-44d7-b935-af8752eab194" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cf28d2-36c2-40cf-b811-782e5a616cef]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:04 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 Jul 10 07:58:04 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Created reservations ['0f988fcc-c426-4c92-9cb5-388f7cbba82a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:04 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:04 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:05 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:05 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194 Jul 10 07:58:05 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:05 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4332e9ad-4553-4c6b-8e3a-c86cc1f3294e tempest-GroupsV320Test-359674675 None] Delete group completed successfully. Jul 10 07:58:05 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1d9ced94-161c-44d7-b935-af8752eab194" returned: 0 in 0.846s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-1d9ced94-161c-44d7-b935-af8752eab194" released by "delete_volume" :: held 1.799s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Created reservations ['e8eec852-da48-42ee-a3c8-998bc2789dbc', 'd8c294f4-b656-4585-be28-5a2b9fbbe9da', '52d2f1ba-32b1-4e67-b8b8-92728b4eca56', '65a29cd2-6b70-41ab-b44c-b5d0bf0f084b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:06 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:06 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-1a7a2a0c-6aff-45ac-ab38-b29181af760e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "cinder-1a7a2a0c-6aff-45ac-ab38-b29181af760e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Acquiring lock "cinder-quobyte-1a7a2a0c-6aff-45ac-ab38-b29181af760e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-1a7a2a0c-6aff-45ac-ab38-b29181af760e" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e0c36-d052-4cc8-b966-6f4f5be798e9]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:06 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:58:06 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:06 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:58:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa58cf13-7724-439e-985e-6e6bd2b0586b tempest-VolumesGetTest-623022283 None] Lock "cinder-1d9ced94-161c-44d7-b935-af8752eab194-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:07 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:07 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:58:07 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:08 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 1 in 1.193s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:08 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e Jul 10 07:58:08 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-9b1a3fa1-c515-4526-ac93-b476b01eb915-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "cinder-9b1a3fa1-c515-4526-ac93-b476b01eb915-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Acquiring lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dced65-cc3c-422b-9fec-edfc17742a0e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:09 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:58:09 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:09 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1a7a2a0c-6aff-45ac-ab38-b29181af760e" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "cinder-quobyte-1a7a2a0c-6aff-45ac-ab38-b29181af760e" released by "delete_volume" :: held 3.101s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Created reservations ['bf72c9b8-4d97-4e06-adc5-809eb2651e2f', 'ffb6f820-b194-4fb2-b2b3-e4841cf21e54', 'cc15410f-a551-4245-8bda-8e5edfd02005', '4ccf5d5b-1517-4f8a-a40a-5cbd6cc57f6b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:09 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:09 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-bfc2bfcf-eef5-49b9-9ebe-8c33d82ffc18 tempest-TestShelveInstance-1719096134 None] Terminate volume connection completed successfully. Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-bfc2bfcf-eef5-49b9-9ebe-8c33d82ffc18 tempest-TestShelveInstance-1719096134 None] Deleting attachment 60e6a3a5-abd3-4259-9c71-5cc29e574f78. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:58:10 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:10 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915 Jul 10 07:58:10 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:10 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Deleted volume successfully. Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93f6911f-e428-4d89-8b79-67e59658f131 tempest-VolumesGetTest-623022283 None] Lock "cinder-1a7a2a0c-6aff-45ac-ab38-b29181af760e-delete_volume" released by "delete_volume" :: held 4.166s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Acquiring lock "cinder-83bca301-e6d3-4e54-a7d9-06a26e475d68-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "cinder-83bca301-e6d3-4e54-a7d9-06a26e475d68-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Acquiring lock "cinder-quobyte-83bca301-e6d3-4e54-a7d9-06a26e475d68" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "cinder-quobyte-83bca301-e6d3-4e54-a7d9-06a26e475d68" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0832baf4-b64f-4b1e-aba5-c4b35ffef95f]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:11 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9b1a3fa1-c515-4526-ac93-b476b01eb915" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "cinder-quobyte-9b1a3fa1-c515-4526-ac93-b476b01eb915" released by "delete_volume" :: held 1.771s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Created reservations ['33ed4659-7cb6-485e-ad04-6642f8940835', '82d6d8ce-d2c1-405c-8ca6-e7342278e537', '6b5b7a3e-314e-4c46-b998-40cde6e211e7', 'adfbe2d3-d7f3-4c2d-b161-3f40c8469361'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:11 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:58:11 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:11 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:11 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:12 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:12 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Deleted volume successfully. Jul 10 07:58:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85e23632-230f-4645-b543-4e0795f2b694 tempest-TestStampPattern-480241403 None] Lock "cinder-9b1a3fa1-c515-4526-ac93-b476b01eb915-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:12 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 1.300s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:12 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:58:12 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:13 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 1 in 1.018s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:13 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68 Jul 10 07:58:13 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:14 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-83bca301-e6d3-4e54-a7d9-06a26e475d68" returned: 0 in 0.749s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "cinder-quobyte-83bca301-e6d3-4e54-a7d9-06a26e475d68" released by "delete_volume" :: held 3.152s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG cinder.quota [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Created reservations ['1395020d-10da-425f-96e7-140595cada6b', '1a07df18-8c84-4f05-a3de-183ffebd8020', 'd63027cf-ae61-434d-9f73-d2a3cd8cdeec', '599c6169-0990-4e12-a5b8-d11a3275770c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:14 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:14 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:15 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.083s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.manager [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Deleted volume successfully. Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-d937294a-4b5f-4618-aa49-a4e414aff3f9 req-dbf74e97-0d4b-404b-a665-38389b743016 tempest-TestShelveInstance-1719096134 None] Lock "cinder-83bca301-e6d3-4e54-a7d9-06a26e475d68-delete_volume" released by "delete_volume" :: held 4.588s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Flow 'volume_create_manager' (e593b5ca-6abc-4524-88cb-89204239d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fef57a4-926b-40b4-abf6-cf19b64c3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fef57a4-926b-40b4-abf6-cf19b64c3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1913664263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04e2e26-cab7-46c4-8632-4eeb21445e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ff9083c29c427d9c396a4eb54e7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:16Z,use_quota=True,user_id='eea7c97b2c22411281f4d85835b08f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf726dc5-d68b-4d71-b8bd-89e5eae1359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf726dc5-d68b-4d71-b8bd-89e5eae1359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6364b3be-7068-4497-b806-03acb0370ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6364b3be-7068-4497-b806-03acb0370ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04e2e26-cab7-46c4-8632-4eeb21445e17', 'volume_name': 'volume-d04e2e26-cab7-46c4-8632-4eeb21445e17', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe7128-06d3-4c6c-b339-5ce70207e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe7128-06d3-4c6c-b339-5ce70207e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6badf18d-7abc-4bb4-aae9-05574022eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Volume d04e2e26-cab7-46c4-8632-4eeb21445e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04e2e26-cab7-46c4-8632-4eeb21445e17', 'volume_size': 1} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1913664263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04e2e26-cab7-46c4-8632-4eeb21445e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ff9083c29c427d9c396a4eb54e7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:16Z,use_quota=True,user_id='eea7c97b2c22411281f4d85835b08f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Creating volume d04e2e26-cab7-46c4-8632-4eeb21445e17 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:15 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:15 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 1073741824 Jul 10 07:58:15 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:17 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 1073741824" returned: 0 in 1.161s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:17 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 Jul 10 07:58:17 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:18 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17" returned: 0 in 0.963s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6badf18d-7abc-4bb4-aae9-05574022eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04e2e26-cab7-46c4-8632-4eeb21445e17', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27879a23-939c-4e15-95ae-f8939db34a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Volume volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 (d04e2e26-cab7-46c4-8632-4eeb21445e17): created successfully Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27879a23-939c-4e15-95ae-f8939db34a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Flow 'volume_create_manager' (e593b5ca-6abc-4524-88cb-89204239d74a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e7ccd124-549f-4e44-b491-9213c892a755 tempest-VolumesNegativeTest-301065822 None] Created volume successfully. Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (456b2045-1ce8-48da-a72d-b0a6faa9d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e356c21d-4c92-42f3-bb89-bb1ed2e899e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e356c21d-4c92-42f3-bb89-bb1ed2e899e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729994928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29ab876-af4b-4a57-9b2d-f6f379a92f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:27Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0a715b-32a4-4f85-9fac-1bb1dc073e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0a715b-32a4-4f85-9fac-1bb1dc073e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad60464-b0dc-4069-a804-61e6397b26fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad60464-b0dc-4069-a804-61e6397b26fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29ab876-af4b-4a57-9b2d-f6f379a92f11', 'volume_name': 'volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59cbc9b-1a2a-4b99-bdb0-a07a036e9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59cbc9b-1a2a-4b99-bdb0-a07a036e9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db754d2-fb32-4da7-910c-981705955cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume c29ab876-af4b-4a57-9b2d-f6f379a92f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11', 'volume_size': 1} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729994928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29ab876-af4b-4a57-9b2d-f6f379a92f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:27Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:27 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 1073741824 Jul 10 07:58:27 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Flow 'volume_create_manager' (5aa5ac56-4e77-452f-8ac5-25825c4ed263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02af5a7e-580e-4e43-8751-2b77fa0e28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02af5a7e-580e-4e43-8751-2b77fa0e28ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372423059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fefaf760-bdb7-427c-97ec-eb1e5fd11840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9481c932b3d46c99b5a4cef4745bcf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:28Z,use_quota=True,user_id='1f312143c4924047969babb78d132c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fdceab-a5ae-47de-aa3e-6ec347972a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fdceab-a5ae-47de-aa3e-6ec347972a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80701053-811c-4d91-96bf-b7fc29db8bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80701053-811c-4d91-96bf-b7fc29db8bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fefaf760-bdb7-427c-97ec-eb1e5fd11840', 'volume_name': 'volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e273d070-262e-4ed7-b80b-793c183caebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e273d070-262e-4ed7-b80b-793c183caebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e914354b-f838-42e9-b519-6d472c4e816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume fefaf760-bdb7-427c-97ec-eb1e5fd11840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840', 'volume_size': 1} Jul 10 07:58:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:28 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 1073741824" returned: 0 in 1.323s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:28 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 Jul 10 07:58:28 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:29 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372423059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fefaf760-bdb7-427c-97ec-eb1e5fd11840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9481c932b3d46c99b5a4cef4745bcf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:28Z,use_quota=True,user_id='1f312143c4924047969babb78d132c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Creating volume fefaf760-bdb7-427c-97ec-eb1e5fd11840 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db754d2-fb32-4da7-910c-981705955cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:29 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 1073741824 Jul 10 07:58:29 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26091f35-1dee-474e-97a2-2268dc4a1f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 (c29ab876-af4b-4a57-9b2d-f6f379a92f11): created successfully Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26091f35-1dee-474e-97a2-2268dc4a1f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (456b2045-1ce8-48da-a72d-b0a6faa9d74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8f78070f-303b-4fba-8250-1f6747d53fb9 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:30 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 1073741824" returned: 0 in 0.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:30 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=98,cinder:UPDATE=116,cinder:INSERT=37,cinder:DELETE=10 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:58:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:30 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 Jul 10 07:58:30 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:31 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e914354b-f838-42e9-b519-6d472c4e816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ff4d93-ba43-4d50-b854-5f501327204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating offline snapshot dd4e1530-de10-4b0c-94b6-bfd19b323d6e of volume c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:58:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 (fefaf760-bdb7-427c-97ec-eb1e5fd11840): created successfully Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ff4d93-ba43-4d50-b854-5f501327204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Flow 'volume_create_manager' (5aa5ac56-4e77-452f-8ac5-25825c4ed263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93923a1-d4eb-4245-8692-e3008f8cf7f1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9ee3cb49-352c-435e-9274-a0f822f28f22 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Created volume successfully. Jul 10 07:58:31 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 Jul 10 07:58:31 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "cinder-fefaf760-bdb7-427c-97ec-eb1e5fd11840-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "cinder-fefaf760-bdb7-427c-97ec-eb1e5fd11840-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "cinder-quobyte-fefaf760-bdb7-427c-97ec-eb1e5fd11840" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "cinder-quobyte-fefaf760-bdb7-427c-97ec-eb1e5fd11840" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e4b8a-d716-4775-b9eb-13bf7f2524ea]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:32 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:32 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e 1G Jul 10 07:58:32 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:32 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 Jul 10 07:58:32 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:33 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840" returned: 0 in 1.174s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:33 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840 Jul 10 07:58:33 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:33 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e 1G" returned: 0 in 1.254s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:33 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e Jul 10 07:58:33 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:34 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fefaf760-bdb7-427c-97ec-eb1e5fd11840" returned: 0 in 0.969s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "cinder-quobyte-fefaf760-bdb7-427c-97ec-eb1e5fd11840" released by "delete_volume" :: held 2.210s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Created reservations ['ffad598e-dea8-425d-878c-81def5247441', '799bfc47-6870-466b-89b3-de057a65b71b', '56c94260-e698-4daa-9ffd-80ebda487ce2', '6b05a5fd-e84c-4270-a809-5341542abb85'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:34 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:34 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e is being set with open permissions: ugo+rw Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:34 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e Jul 10 07:58:34 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Flow 'volume_create_manager' (8d1ea524-6f5c-4b1c-bcba-8376c681f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062e775b-ff26-47c8-b883-2db0cf905dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:34 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:34 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062e775b-ff26-47c8-b883-2db0cf905dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220faddd-d5b9-4341-a3df-8a5b2503cd92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8dbb0643b6457fa9afbe6179ae5863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:34Z,use_quota=True,user_id='2b91c996f89548389a954539d8a0afb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(818893a6-da6a-438a-8174-f6c61e1e8ee7),volume_type_id=818893a6-da6a-438a-8174-f6c61e1e8ee7)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402684ec-cf1e-445a-8238-5f783da440d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402684ec-cf1e-445a-8238-5f783da440d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d597aa-e4cf-4699-bbe2-d379d8f462e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d597aa-e4cf-4699-bbe2-d379d8f462e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '220faddd-d5b9-4341-a3df-8a5b2503cd92', 'volume_name': 'volume-220faddd-d5b9-4341-a3df-8a5b2503cd92', 'volume_size': 1, 'image_id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e410a9124f5db2f97ac3d7796b6e528', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed8dbb0643b6457fa9afbe6179ae5863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c560b1cf6a147a603c1faad5504b43b8ae4547fce4dcb084fca0c69661b8b279bae6b29a90158f1f5008d1f661f36d32256d75c73f7cfb27c2ad0bb1404c168c', 'id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'created_at': datetime.datetime(2026, 7, 10, 5, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e175d207-082e-4239-8886-69c0faaa62aa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afcc11a-ab00-4439-aa7e-f5db22685933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afcc11a-ab00-4439-aa7e-f5db22685933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d5b79b-ec9a-423f-b7f8-dc04647a664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Volume 220faddd-d5b9-4341-a3df-8a5b2503cd92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-220faddd-d5b9-4341-a3df-8a5b2503cd92', 'volume_size': 1, 'image_id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e410a9124f5db2f97ac3d7796b6e528', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed8dbb0643b6457fa9afbe6179ae5863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c560b1cf6a147a603c1faad5504b43b8ae4547fce4dcb084fca0c69661b8b279bae6b29a90158f1f5008d1f661f36d32256d75c73f7cfb27c2ad0bb1404c168c', 'id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'created_at': datetime.datetime(2026, 7, 10, 5, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e175d207-082e-4239-8886-69c0faaa62aa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 07:58:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Trying to clone 220faddd-d5b9-4341-a3df-8a5b2503cd92 from image e175d207-082e-4239-8886-69c0faaa62aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:58:35 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Image download 0.00 MB at 0.00 MB/s Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6b9d1-2dbf-40af-a3d8-3e3240456209]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:35 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:35 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:35 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.958s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:35 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Deleted volume successfully. Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e" returned: 0 in 1.063s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-43120958-a727-40f2-ad6a-476c0324d749 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "cinder-fefaf760-bdb7-427c-97ec-eb1e5fd11840-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:35 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info Jul 10 07:58:35 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Flow 'volume_create_manager' (198c7550-e704-4857-b06a-b0b565d239e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea05ea3-79cf-4a9f-a110-e454adf009c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:36 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea05ea3-79cf-4a9f-a110-e454adf009c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2100096934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a2a377-1b51-4faa-9166-d06d6c435bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9481c932b3d46c99b5a4cef4745bcf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:36Z,use_quota=True,user_id='1f312143c4924047969babb78d132c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d01a39-f565-4d6b-aeff-c0e2524fbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d01a39-f565-4d6b-aeff-c0e2524fbd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bf8568-beed-48f7-817b-2cd565f4b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bf8568-beed-48f7-817b-2cd565f4b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a2a377-1b51-4faa-9166-d06d6c435bbd', 'volume_name': 'volume-26a2a377-1b51-4faa-9166-d06d6c435bbd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3176188-ee1e-4f33-81fb-12a509102635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3176188-ee1e-4f33-81fb-12a509102635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7729a4ee-b513-4de8-bcd5-1d276b28e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume 26a2a377-1b51-4faa-9166-d06d6c435bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a2a377-1b51-4faa-9166-d06d6c435bbd', 'volume_size': 1} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 0 in 1.278s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:36 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:36 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:36 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:36 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:36 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info" returned: 0 in 1.027s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info is being set with open permissions: ugo+rw Jul 10 07:58:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:36 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info Jul 10 07:58:36 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:37 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.040s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:58:37 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 1 in 1.199s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Temporary image e175d207-082e-4239-8886-69c0faaa62aa is fetched for user 2b91c996f89548389a954539d8a0afb0. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:58:37 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.info" returned: 0 in 1.013s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.445s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2100096934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a2a377-1b51-4faa-9166-d06d6c435bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9481c932b3d46c99b5a4cef4745bcf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:36Z,use_quota=True,user_id='1f312143c4924047969babb78d132c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Creating volume 26a2a377-1b51-4faa-9166-d06d6c435bbd {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:37 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:37 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd 1073741824 Jul 10 07:58:37 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f25de-a718-4d8b-90bc-0deecedd6074]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f50a9e7b-7f50-49c3-ae7f-898c0c9fe42d tempest-CreateVolumesFromSnapshotTest-1486406392 None] Create snapshot completed successfully Jul 10 07:58:37 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:37 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:38 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd 1073741824" returned: 0 in 1.151s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:38 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (371dec44-f832-499b-99a1-c131048403cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:38 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfcb66b-7a00-448e-a381-65da4651dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 0 in 1.194s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfcb66b-7a00-448e-a381-65da4651dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373869151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08132539-5583-483d-9f11-fec672d145ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:39Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b8a71d-e5b1-478f-be75-c43640b6f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b8a71d-e5b1-478f-be75-c43640b6f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c0af92-190a-481e-819a-ea3efb279dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c0af92-190a-481e-819a-ea3efb279dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08132539-5583-483d-9f11-fec672d145ec', 'volume_name': 'volume-08132539-5583-483d-9f11-fec672d145ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcfa8a1-963a-4c72-8d89-46d9a8f33486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcfa8a1-963a-4c72-8d89-46d9a8f33486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09fdfd0-aba6-48da-973b-827591d70c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume 08132539-5583-483d-9f11-fec672d145ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08132539-5583-483d-9f11-fec672d145ec', 'volume_size': 1} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:39 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:39 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:39 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd Jul 10 07:58:39 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (9bbc7239-2c59-4f0c-b0f7-768806563ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e66b8e-6278-4680-b0a2-a723263dcbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e66b8e-6278-4680-b0a2-a723263dcbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791539075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:40Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14410ad0-09c7-4b43-8139-6df26aabccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14410ad0-09c7-4b43-8139-6df26aabccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b34d6c-ec2f-4f01-9fc5-b32e05f13202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b34d6c-ec2f-4f01-9fc5-b32e05f13202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7', 'volume_name': 'volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904f6c74-b89a-445b-a871-03bdd0d78f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904f6c74-b89a-445b-a871-03bdd0d78f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902905d1-5ce0-4b45-9d87-78dba2e8a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume 00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7', 'volume_size': 1} Jul 10 07:58:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:40 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (5ac067d9-7307-447d-8b62-c77b64b3967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6631575-016f-4009-afd2-3d05f18e5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 1 in 1.338s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6631575-016f-4009-afd2-3d05f18e5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654927292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85924aed-cac9-44c4-84cb-ab1273a39f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:40Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff6d655-9f06-47cb-82c4-e4618c5a69aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff6d655-9f06-47cb-82c4-e4618c5a69aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776527a1-b407-4022-90c9-551bb37a2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776527a1-b407-4022-90c9-551bb37a2b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85924aed-cac9-44c4-84cb-ab1273a39f5f', 'volume_name': 'volume-85924aed-cac9-44c4-84cb-ab1273a39f5f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaea49f5-086d-4b39-9171-200383226621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaea49f5-086d-4b39-9171-200383226621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853b1a27-8133-4abb-9a75-b1cc1a32ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume 85924aed-cac9-44c4-84cb-ab1273a39f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85924aed-cac9-44c4-84cb-ab1273a39f5f', 'volume_size': 1} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd" returned: 0 in 1.260s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] <== create_volume: return (2664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373869151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08132539-5583-483d-9f11-fec672d145ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:39Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume 08132539-5583-483d-9f11-fec672d145ec {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:40 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:40 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec 1073741824 Jul 10 07:58:40 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7729a4ee-b513-4de8-bcd5-1d276b28e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a2a377-1b51-4faa-9166-d06d6c435bbd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99a4e96-e5cb-41a3-9aca-adf0163c8901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Volume volume-26a2a377-1b51-4faa-9166-d06d6c435bbd (26a2a377-1b51-4faa-9166-d06d6c435bbd): created successfully Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99a4e96-e5cb-41a3-9aca-adf0163c8901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Flow 'volume_create_manager' (198c7550-e704-4857-b06a-b0b565d239e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7f386f96-5714-404c-b603-2a105a8de2e3 tempest-VolumeQuotasAdminTestJSON-1535826315 None] Created volume successfully. Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (cadf460d-7819-4dd1-ad0b-b71772cb4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351e3753-11b7-42f6-8cc3-e9093f5d3d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351e3753-11b7-42f6-8cc3-e9093f5d3d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112015080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fef35f3-ad73-4ce7-ab7d-d6e087ab8015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:41Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083bcf6-079c-4bbd-8be2-57e390bee4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083bcf6-079c-4bbd-8be2-57e390bee4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87441064-518a-4522-b0e0-22cd400b7b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87441064-518a-4522-b0e0-22cd400b7b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fef35f3-ad73-4ce7-ab7d-d6e087ab8015', 'volume_name': 'volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ef42ad-0e98-4cdd-a227-4cb6e747d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ef42ad-0e98-4cdd-a227-4cb6e747d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38113d47-1a1d-4cf8-9d61-1c5cd91f6fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume 5fef35f3-ad73-4ce7-ab7d-d6e087ab8015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015', 'volume_size': 1} Jul 10 07:58:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (85ad1b69-e5c7-473e-853f-4982086102e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf5c10-7b7f-4573-9d15-52e681df53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf5c10-7b7f-4573-9d15-52e681df53cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939152088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cfad6c-c4bd-4e69-9c59-e5fda29c4961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:41Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5606718-334a-4e8e-8b75-be32c8f2bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5606718-334a-4e8e-8b75-be32c8f2bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33139cd4-edd1-4649-bb3e-d8b169dd7a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33139cd4-edd1-4649-bb3e-d8b169dd7a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cfad6c-c4bd-4e69-9c59-e5fda29c4961', 'volume_name': 'volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71379346-abe3-498c-89d7-b67aa764575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71379346-abe3-498c-89d7-b67aa764575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47390e5a-0908-41bd-98e2-ff2e866dce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume f4cfad6c-c4bd-4e69-9c59-e5fda29c4961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961', 'volume_size': 1} Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:41 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec 1073741824" returned: 0 in 1.357s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a96e3382-0359-4c8c-b1d4-cfe9a40aa6fb tempest-VolumeQuotasAdminTestJSON-1054826923 None] Transfer volume completed successfully. Jul 10 07:58:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:41 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec Jul 10 07:58:41 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:42 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec" returned: 0 in 0.780s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791539075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:40Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume 00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:42 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09fdfd0-aba6-48da-973b-827591d70c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08132539-5583-483d-9f11-fec672d145ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:42 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 1073741824 Jul 10 07:58:42 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf86e6-662b-410f-9dc0-4625d1724c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-08132539-5583-483d-9f11-fec672d145ec (08132539-5583-483d-9f11-fec672d145ec): created successfully Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf86e6-662b-410f-9dc0-4625d1724c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (371dec44-f832-499b-99a1-c131048403cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ec7793a8-76b4-4f56-95d6-3820bd87debf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Acquiring lock "cinder-26a2a377-1b51-4faa-9166-d06d6c435bbd-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "cinder-26a2a377-1b51-4faa-9166-d06d6c435bbd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Acquiring lock "cinder-quobyte-26a2a377-1b51-4faa-9166-d06d6c435bbd" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "cinder-quobyte-26a2a377-1b51-4faa-9166-d06d6c435bbd" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[114b26ea-4e4a-4bb1-b8c4-017046fe3629]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:42 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd Jul 10 07:58:42 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:43 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 1073741824" returned: 0 in 0.894s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:43 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 Jul 10 07:58:43 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:43 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd" returned: 0 in 0.832s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:43 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd Jul 10 07:58:43 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:44 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.934s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220faddd-d5b9-4341-a3df-8a5b2503cd92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8dbb0643b6457fa9afbe6179ae5863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:34Z,use_quota=True,user_id='2b91c996f89548389a954539d8a0afb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(818893a6-da6a-438a-8174-f6c61e1e8ee7),volume_type_id=818893a6-da6a-438a-8174-f6c61e1e8ee7)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Creating volume 220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902905d1-5ce0-4b45-9d87-78dba2e8a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:44 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1073741824 Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c5ee61-786c-4604-a6a5-4a22d0417cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:44 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:44 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 (00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7): created successfully Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c5ee61-786c-4604-a6a5-4a22d0417cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (9bbc7239-2c59-4f0c-b0f7-768806563ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-81f5ae1c-b2e2-4970-bdcb-9a4df58276ac tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:44 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-26a2a377-1b51-4faa-9166-d06d6c435bbd" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "cinder-quobyte-26a2a377-1b51-4faa-9166-d06d6c435bbd" released by "delete_volume" :: held 1.570s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Created reservations ['c5ab7578-2e79-451b-a4bd-2dfdf29047c5', '1442e3e0-0799-420d-af41-102b14da841d', '44665796-e730-447a-b00b-d15121e903ce', 'e5e30dbe-2918-43c2-b6f7-1697554265fc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:44 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:44 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:45 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1073741824" returned: 0 in 0.979s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:45 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:45 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Deleted volume successfully. Jul 10 07:58:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1e60470b-108e-41b8-9841-1b191111e0d8 tempest-VolumeQuotasAdminTestJSON-401081423 None] Lock "cinder-26a2a377-1b51-4faa-9166-d06d6c435bbd-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:45 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:45 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:46 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.612s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654927292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85924aed-cac9-44c4-84cb-ab1273a39f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:40Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume 85924aed-cac9-44c4-84cb-ab1273a39f5f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:46 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f 1073741824 Jul 10 07:58:46 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Attempting download of e175d207-082e-4239-8886-69c0faaa62aa ((None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}])) to volume 220faddd-d5b9-4341-a3df-8a5b2503cd92. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2455ff-1c44-4933-a810-63b941bbf1ef]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:46 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz Jul 10 07:58:46 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:47 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz" returned: 0 in 0.971s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:47 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f 1073741824" returned: 0 in 1.122s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:47 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f Jul 10 07:58:47 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:47 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz Jul 10 07:58:47 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:48 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz" returned: 1 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e175d207-082e-4239-8886-69c0faaa62aa_qijk9caz' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238dae5-f1ae-4c68-a6f5-e02b04d33e4c]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:48 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.218s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112015080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fef35f3-ad73-4ce7-ab7d-d6e087ab8015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:41Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume 5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:48 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853b1a27-8133-4abb-9a75-b1cc1a32ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85924aed-cac9-44c4-84cb-ab1273a39f5f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaca06e-a5b8-44ef-87b9-f4942f9e3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:48 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 1073741824 Jul 10 07:58:48 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-85924aed-cac9-44c4-84cb-ab1273a39f5f (85924aed-cac9-44c4-84cb-ab1273a39f5f): created successfully Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaca06e-a5b8-44ef-87b9-f4942f9e3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (5ac067d9-7307-447d-8b62-c77b64b3967d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:48 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:48 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-01c84c4e-5454-4baf-9e6d-baa25e0a228e tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:49 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:49 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD Jul 10 07:58:49 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:49 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 1073741824" returned: 0 in 1.292s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=95,cinder:UPDATE=118,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:49 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 Jul 10 07:58:49 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:49 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD" returned: 1 in 0.904s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] e175d207-082e-4239-8886-69c0faaa62aa was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:58:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:50 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:50 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:50 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.801s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-939152088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cfad6c-c4bd-4e69-9c59-e5fda29c4961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adc18e1182a4f158f2bda9cf4018500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:58:41Z,use_quota=True,user_id='7b64d43d281a44daaed56a4aeae366c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Creating volume f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:58:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38113d47-1a1d-4cf8-9d61-1c5cd91f6fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:50 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 1073741824 Jul 10 07:58:50 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f3e574-6abf-4e2c-9510-162f2d186448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 (5fef35f3-ad73-4ce7-ab7d-d6e087ab8015): created successfully Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f3e574-6abf-4e2c-9510-162f2d186448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (cadf460d-7819-4dd1-ad0b-b71772cb4275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-149978d9-d6fd-4268-9d4d-6d6096a03bcf tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:50 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e175d207-082e-4239-8886-69c0faaa62aa_8r_qawp3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:58:50 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 07:58:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:50 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1G Jul 10 07:58:50 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:51 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 1073741824" returned: 0 in 1.428s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:51 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 Jul 10 07:58:51 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:52 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 1G" returned: 0 in 1.131s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4ad300-3315-497c-ab75-4ff721ed8e09]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:52 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:52 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:52 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" returned: 0 in 0.818s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47390e5a-0908-41bd-98e2-ff2e866dce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cd694-5c16-4425-9eeb-22b054760349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Volume volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 (f4cfad6c-c4bd-4e69-9c59-e5fda29c4961): created successfully Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cd694-5c16-4425-9eeb-22b054760349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Flow 'volume_create_manager' (85ad1b69-e5c7-473e-853f-4982086102e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-289a6e1f-6033-4b3b-a7c4-4a816b24a413 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created volume successfully. Jul 10 07:58:53 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:53 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:53 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[128120d6-e088-4b8f-be5f-7f656bc2d520]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:53 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 Jul 10 07:58:53 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Acquiring lock "cinder-d04e2e26-cab7-46c4-8632-4eeb21445e17-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "cinder-d04e2e26-cab7-46c4-8632-4eeb21445e17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Acquiring lock "cinder-quobyte-d04e2e26-cab7-46c4-8632-4eeb21445e17" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "cinder-quobyte-d04e2e26-cab7-46c4-8632-4eeb21445e17" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf3d11-eb73-4f48-93ba-76cd8226214c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:54 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 1 in 1.064s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Downloaded image e175d207-082e-4239-8886-69c0faaa62aa ((None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}])) to volume 220faddd-d5b9-4341-a3df-8a5b2503cd92 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Temporary image e175d207-082e-4239-8886-69c0faaa62aa for user 2b91c996f89548389a954539d8a0afb0 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Marking volume 220faddd-d5b9-4341-a3df-8a5b2503cd92 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Copying metadata from image e175d207-082e-4239-8886-69c0faaa62aa to 220faddd-d5b9-4341-a3df-8a5b2503cd92. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Creating volume glance metadata for volume 220faddd-d5b9-4341-a3df-8a5b2503cd92 backed by image e175d207-082e-4239-8886-69c0faaa62aa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6e410a9124f5db2f97ac3d7796b6e528', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:58:54 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 Jul 10 07:58:54 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d5b79b-ec9a-423f-b7f8-dc04647a664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220faddd-d5b9-4341-a3df-8a5b2503cd92', 'volume_size': 1, 'image_id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e175d207-082e-4239-8886-69c0faaa62aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e410a9124f5db2f97ac3d7796b6e528', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed8dbb0643b6457fa9afbe6179ae5863', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c560b1cf6a147a603c1faad5504b43b8ae4547fce4dcb084fca0c69661b8b279bae6b29a90158f1f5008d1f661f36d32256d75c73f7cfb27c2ad0bb1404c168c', 'id': 'e175d207-082e-4239-8886-69c0faaa62aa', 'created_at': datetime.datetime(2026, 7, 10, 5, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e175d207-082e-4239-8886-69c0faaa62aa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71dcb65-4e4d-47b0-adb1-3232210f8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:58:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Volume volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 (220faddd-d5b9-4341-a3df-8a5b2503cd92): created successfully Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71dcb65-4e4d-47b0-adb1-3232210f8c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Flow 'volume_create_manager' (8d1ea524-6f5c-4b1c-bcba-8376c681f98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:58:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-df091e3d-a407-41cb-b2ba-333bcd5b94cc tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Created volume successfully. Jul 10 07:58:54 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:54 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961 Jul 10 07:58:54 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:54 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17" returned: 0 in 0.879s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:54 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17 Jul 10 07:58:54 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Acquiring lock "cinder-220faddd-d5b9-4341-a3df-8a5b2503cd92-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:55 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" returned: 0 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "cinder-220faddd-d5b9-4341-a3df-8a5b2503cd92-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961" released by "delete_volume" :: held 1.666s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Acquiring lock "cinder-quobyte-220faddd-d5b9-4341-a3df-8a5b2503cd92" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "cinder-quobyte-220faddd-d5b9-4341-a3df-8a5b2503cd92" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['0f1ae8fe-2168-4cc5-ad34-d7207f2b94cd', '3b65bef1-e76a-4726-ae42-57b4effdf412', '8571a248-709a-4c3a-8fad-a2c46d45f584', '07c3aa84-310e-4a62-8147-c6ed09d77ddd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2563c258-a9a1-4e8c-820d-84fac030f6af]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:55 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:55 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:55 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:55 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:55 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d04e2e26-cab7-46c4-8632-4eeb21445e17" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "cinder-quobyte-d04e2e26-cab7-46c4-8632-4eeb21445e17" released by "delete_volume" :: held 1.733s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Created reservations ['2a60bf41-efc2-4f10-908e-2ad9c4e34534', 'ba070809-f40d-4716-8b36-ce36d9e52943', 'b54c021b-bac1-4f33-80e8-fd2e036825b5', '7dc0c05e-2eca-4dc3-bf26-e9fbdcadd28a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:56 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:56 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" acquired by "delete_volume" :: waited 0.074s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a3722-a1c4-472b-b174-ca0beaaae92f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:56 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 Jul 10 07:58:56 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:56 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.066s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:56 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 0 in 1.174s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c7807060-b941-4e92-85fa-71d535352b2b tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-f4cfad6c-c4bd-4e69-9c59-e5fda29c4961-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:56 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:56 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:57 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.067s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Deleted volume successfully. Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0635beb-5e64-4cba-a996-11bdc2b07d3d tempest-VolumesNegativeTest-301065822 None] Lock "cinder-d04e2e26-cab7-46c4-8632-4eeb21445e17-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:57 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" returned: 0 in 1.261s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:57 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015 Jul 10 07:58:57 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:57 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 1 in 1.166s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:58:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:57 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92 Jul 10 07:58:57 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:58 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" returned: 0 in 0.761s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015" released by "delete_volume" :: held 2.101s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['7f723489-54ed-4b54-8b48-7030186ff170', '622efb9e-5f4d-4dc8-a141-e69efefaf89a', '8bf5ee88-7707-4bed-ae61-9235b40b16b5', '0053739f-fa40-4890-bb3f-315ed19aad3c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:58 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:58 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:58 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-220faddd-d5b9-4341-a3df-8a5b2503cd92" returned: 0 in 0.902s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "cinder-quobyte-220faddd-d5b9-4341-a3df-8a5b2503cd92" released by "delete_volume" :: held 3.328s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:58 devstack cinder-volume[87192]: WARNING cinder.quota [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:58:58 devstack cinder-volume[87192]: WARNING cinder.quota [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Created reservations ['a7ec4af9-5ba6-437e-a99e-3dccb19e2e15', 'd6d322ee-7b22-4ff1-8e42-32b27f26d430', '7abd5154-8a63-4058-a76a-1423ef348d29', 'dbc21103-f1b3-4db0-bf1f-df4206fa4b71'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:58 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:58:58 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:59 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96aeccc8-4f7d-4d5b-8111-e5b16bde55e6 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-5fef35f3-ad73-4ce7-ab7d-d6e087ab8015-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-85924aed-cac9-44c4-84cb-ab1273a39f5f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-85924aed-cac9-44c4-84cb-ab1273a39f5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-85924aed-cac9-44c4-84cb-ab1273a39f5f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-85924aed-cac9-44c4-84cb-ab1273a39f5f" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f7f131-58f6-43d3-83e6-c7c129c86b77]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:58:59 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f Jul 10 07:58:59 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:58:59 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:58:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Deleted volume successfully. Jul 10 07:58:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2627dd80-03b3-404f-8599-3b6b723c6d54 tempest-VolumeAndVolumeTypeFromImageTest-2085641757 None] Lock "cinder-220faddd-d5b9-4341-a3df-8a5b2503cd92-delete_volume" released by "delete_volume" :: held 4.519s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Flow 'volume_create_manager' (6820da47-7fbf-40af-85d5-d8c5a70c5209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bec76a-ef04-43b1-baf8-474701204ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bec76a-ef04-43b1-baf8-474701204ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-511680793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3393d2-e363-4408-98cd-5afb47e2dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793c287c1c75430cb93c0184eaa90b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:00Z,use_quota=True,user_id='da84c06dd89f46f6a0dbe502dccb1a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc0aad0-80be-415c-ab2d-f1f1b82b69ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc0aad0-80be-415c-ab2d-f1f1b82b69ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d286c9-a545-4e23-bdbf-b0a65e9c14b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d286c9-a545-4e23-bdbf-b0a65e9c14b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3393d2-e363-4408-98cd-5afb47e2dea0', 'volume_name': 'volume-3c3393d2-e363-4408-98cd-5afb47e2dea0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0be122-852c-4636-aa0c-a34e069dc270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0be122-852c-4636-aa0c-a34e069dc270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd455a-c04c-463b-b09e-a67b0e8f8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Volume 3c3393d2-e363-4408-98cd-5afb47e2dea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3393d2-e363-4408-98cd-5afb47e2dea0', 'volume_size': 1} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-511680793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3393d2-e363-4408-98cd-5afb47e2dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793c287c1c75430cb93c0184eaa90b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:00Z,use_quota=True,user_id='da84c06dd89f46f6a0dbe502dccb1a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Creating volume 3c3393d2-e363-4408-98cd-5afb47e2dea0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:00 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 1073741824 Jul 10 07:59:00 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:00 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f" returned: 0 in 1.194s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:00 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f Jul 10 07:59:00 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:01 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-85924aed-cac9-44c4-84cb-ab1273a39f5f" returned: 0 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-85924aed-cac9-44c4-84cb-ab1273a39f5f" released by "delete_volume" :: held 2.184s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:01 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 1073741824" returned: 0 in 1.229s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['b7b1441b-30c8-4360-986b-54de411fcd3a', '2883e843-70d9-431d-92df-690a0b5b9cba', '14fa122b-ae2e-4fe1-a287-4a23d275102e', '14ddaf7b-7a03-42e2-b4a5-ff5492d66670'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:01 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 Jul 10 07:59:01 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:01 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:01 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:02 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd455a-c04c-463b-b09e-a67b0e8f8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3393d2-e363-4408-98cd-5afb47e2dea0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4dde26-a78a-4f17-85e2-392d2e46c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Volume volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 (3c3393d2-e363-4408-98cd-5afb47e2dea0): created successfully Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4dde26-a78a-4f17-85e2-392d2e46c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Flow 'volume_create_manager' (6820da47-7fbf-40af-85d5-d8c5a70c5209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f86893b6-8500-4942-b3fb-4d96c929c660 tempest-AbsoluteLimitsTests-1128362319 None] Created volume successfully. Jul 10 07:59:02 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1517ce84-a941-413c-9ff1-026c52ae7990 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-85924aed-cac9-44c4-84cb-ab1273a39f5f-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7242af3-4191-482c-b54a-ac4c02994947]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:03 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 Jul 10 07:59:03 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Acquiring lock "cinder-3c3393d2-e363-4408-98cd-5afb47e2dea0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "cinder-3c3393d2-e363-4408-98cd-5afb47e2dea0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Acquiring lock "cinder-quobyte-3c3393d2-e363-4408-98cd-5afb47e2dea0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "cinder-quobyte-3c3393d2-e363-4408-98cd-5afb47e2dea0" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1b6a7-900d-468f-b429-c38f1b168ba9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:04 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 Jul 10 07:59:04 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:04 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:04 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7 Jul 10 07:59:04 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:04 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0" returned: 0 in 0.913s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:04 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0 Jul 10 07:59:04 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:04 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7" released by "delete_volume" :: held 2.012s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['5d3f3ffa-fa12-4dc2-b310-6a4a72a56d7b', '79c5b7b3-bcff-4a15-931c-ed9232dafc19', 'ede6c628-1f1b-43cc-b902-42be93e61d55', 'ead36eb4-48fb-4088-ba49-7da0e2ed25bd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:05 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:05 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-08132539-5583-483d-9f11-fec672d145ec-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-08132539-5583-483d-9f11-fec672d145ec-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-08132539-5583-483d-9f11-fec672d145ec" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-08132539-5583-483d-9f11-fec672d145ec" acquired by "delete_volume" :: waited 0.066s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874dfd9-fbe1-4784-a651-9202daf07b6f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:05 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec Jul 10 07:59:05 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:05 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3c3393d2-e363-4408-98cd-5afb47e2dea0" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "cinder-quobyte-3c3393d2-e363-4408-98cd-5afb47e2dea0" released by "delete_volume" :: held 2.153s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (157051f3-a141-4200-8162-5077bbbb9cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501dcba7-792f-47f9-b362-9cac34e8647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501dcba7-792f-47f9-b362-9cac34e8647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272127612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b26692-1c9a-4273-a90e-71da58f1f069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:06Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2679c78-fb23-4e54-a812-49811af209b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2679c78-fb23-4e54-a812-49811af209b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee405d15-68e1-4a97-9a68-32defc3bb591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee405d15-68e1-4a97-9a68-32defc3bb591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b26692-1c9a-4273-a90e-71da58f1f069', 'volume_name': 'volume-20b26692-1c9a-4273-a90e-71da58f1f069', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902ccd0b-e2b1-4850-b022-a10c82b7a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902ccd0b-e2b1-4850-b022-a10c82b7a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ef93eb-d2d2-41b9-a952-39270e8280d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Volume 20b26692-1c9a-4273-a90e-71da58f1f069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b26692-1c9a-4273-a90e-71da58f1f069', 'volume_size': 1} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-272127612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b26692-1c9a-4273-a90e-71da58f1f069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:06Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Creating volume 20b26692-1c9a-4273-a90e-71da58f1f069 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:06 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 1073741824 Jul 10 07:59:06 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Created reservations ['c4ce452c-0f2c-469f-a6a5-83d0a6afa37f', 'aa9b6640-77b5-4b75-a2a0-e37c9234f604', '2b876a55-5471-4eca-9f4f-e396b2636721', '319d60c9-a7ea-4998-ab47-63296d9d572e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:06 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.573s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a04ab1f7-e913-4ac6-8445-df02445a3a65 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-00f3af32-54ef-4d17-88fb-4b8c9ea7e7c7-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:06 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:06 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (297da5f0-e9ec-4319-841b-e6d404dca4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1ce9b7-3f76-4549-bc9e-b6be4bc5fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1ce9b7-3f76-4549-bc9e-b6be4bc5fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814486668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0506ecf1-dcb5-4cd8-939a-e81b5e2cec11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:07Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb60fa34-a8af-41ea-b4db-6ab4496c005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb60fa34-a8af-41ea-b4db-6ab4496c005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8c79db-78ef-4769-a7b1-4d793025d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8c79db-78ef-4769-a7b1-4d793025d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0506ecf1-dcb5-4cd8-939a-e81b5e2cec11', 'volume_name': 'volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01fd711-d590-486e-97c6-c064056979b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01fd711-d590-486e-97c6-c064056979b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53f051d-1cf4-493e-a066-2c7758788e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Volume 0506ecf1-dcb5-4cd8-939a-e81b5e2cec11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11', 'volume_size': 1} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec" returned: 0 in 1.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:07 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec Jul 10 07:59:07 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (67e7be00-da8e-44d6-ab94-9988f6137768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:07 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996c1c06-6fcb-43f4-9a1e-f7edc0ba80c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.025s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Deleted volume successfully. Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996c1c06-6fcb-43f4-9a1e-f7edc0ba80c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e297d6-d2c9-4597-884c-9cbc07f0c7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:08Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c83357-af51-4bd7-8723-b03892228ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c83357-af51-4bd7-8723-b03892228ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66d04eb-e93f-45de-b977-caa780959bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66d04eb-e93f-45de-b977-caa780959bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e297d6-d2c9-4597-884c-9cbc07f0c7ea', 'volume_name': 'volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a73647-7e56-4078-972e-6c271e0e886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a73647-7e56-4078-972e-6c271e0e886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262e17ff-411e-4dcb-ac7d-bfbd152ffd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Volume b6e297d6-d2c9-4597-884c-9cbc07f0c7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea', 'volume_size': 1} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18f93faa-bb42-4272-b12d-48ae19ec659b tempest-AbsoluteLimitsTests-1128362319 None] Lock "cinder-3c3393d2-e363-4408-98cd-5afb47e2dea0-delete_volume" released by "delete_volume" :: held 4.220s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:08 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 1073741824" returned: 0 in 1.988s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (c8fed0dc-c08d-422d-b7c0-5e23d4832d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c5661-acb7-4755-8c11-e8122ba737ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c5661-acb7-4755-8c11-e8122ba737ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672647867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7be9e4-f20e-4eca-9037-777bb41cb3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:08Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42296374-971b-4cb8-b32c-a1fdac54c315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42296374-971b-4cb8-b32c-a1fdac54c315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1acc7e-cad8-48b7-9ec3-0e676c21136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1acc7e-cad8-48b7-9ec3-0e676c21136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7be9e4-f20e-4eca-9037-777bb41cb3aa', 'volume_name': 'volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e1802-22fc-4db6-9a79-9aab78b01bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e1802-22fc-4db6-9a79-9aab78b01bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c33e6a7-5c3d-4b15-aa44-53e8b7433515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Volume 0e7be9e4-f20e-4eca-9037-777bb41cb3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa', 'volume_size': 1} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:08 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 Jul 10 07:59:08 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (d98f7efd-ea45-4d26-ba49-883398418aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:09 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3585fb77-3e52-4533-9895-feb57ef06e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-08132539-5583-483d-9f11-fec672d145ec" returned: 0 in 1.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3585fb77-3e52-4533-9895-feb57ef06e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224101738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c874bd2e-02a0-41ff-8ea8-b971304b1eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:09Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804a5c9c-3743-432e-846e-7c1b2135aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804a5c9c-3743-432e-846e-7c1b2135aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e29f3-2122-4d01-abb1-1ab6077dc4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e29f3-2122-4d01-abb1-1ab6077dc4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c874bd2e-02a0-41ff-8ea8-b971304b1eb1', 'volume_name': 'volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3692af2-8db1-49c2-8a33-ff4e0eacfbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3692af2-8db1-49c2-8a33-ff4e0eacfbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524f1f18-ab56-4b0c-81a5-bc515fd1d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Volume c874bd2e-02a0-41ff-8ea8-b971304b1eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1', 'volume_size': 1} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-08132539-5583-483d-9f11-fec672d145ec" released by "delete_volume" :: held 3.709s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['5b9f1040-47f2-4547-8951-a5b3220e297c', 'bb7e594d-a829-4b39-89c3-2a1b6333706f', '6f463c43-6ab5-49fe-944e-dfc51aebd70b', '9b8efa38-c4c6-4ce3-b383-959f05d20f3d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:09 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:09 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:09 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069" returned: 0 in 1.156s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] <== create_volume: return (3382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.388s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.448s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814486668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0506ecf1-dcb5-4cd8-939a-e81b5e2cec11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:07Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Creating volume 0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:09 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ef93eb-d2d2-41b9-a952-39270e8280d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b26692-1c9a-4273-a90e-71da58f1f069', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 1073741824 Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc268328-5fac-42d5-a9a0-100bca75a596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:09 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Volume volume-20b26692-1c9a-4273-a90e-71da58f1f069 (20b26692-1c9a-4273-a90e-71da58f1f069): created successfully Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc268328-5fac-42d5-a9a0-100bca75a596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (157051f3-a141-4200-8162-5077bbbb9cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bc5c25c5-b42e-471e-a64d-cf4ae9c48775 tempest-CreateVolumesFromImageTest-521237859 None] Created volume successfully. Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-dd4e1530-de10-4b0c-94b6-bfd19b323d6e-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-dd4e1530-de10-4b0c-94b6-bfd19b323d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-dd4e1530-de10-4b0c-94b6-bfd19b323d6e" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-dd4e1530-de10-4b0c-94b6-bfd19b323d6e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleting offline snapshot dd4e1530-de10-4b0c-94b6-bfd19b323d6e of volume c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] snapshot_file for this snap is: volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865a065-7b44-4321-8c5a-91328a442b28]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:10 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e Jul 10 07:59:10 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:10 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.146s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5b9e0acf-f67a-46e9-b223-67ae92c24267 tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-08132539-5583-483d-9f11-fec672d145ec-delete_volume" released by "delete_volume" :: held 5.210s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:10 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 1073741824" returned: 0 in 1.128s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:10 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 Jul 10 07:59:10 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:11 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e" returned: 0 in 1.124s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a66c96-40f3-42d7-8084-6e4f29b6056a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:11 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 Jul 10 07:59:11 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:11 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" returned: 0 in 0.903s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995433759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e297d6-d2c9-4597-884c-9cbc07f0c7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:08Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Creating volume b6e297d6-d2c9-4597-884c-9cbc07f0c7ea {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:11 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea 1073741824 Jul 10 07:59:11 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53f051d-1cf4-493e-a066-2c7758788e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1364813-0a9e-4185-8511-99a26d83e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Volume volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 (0506ecf1-dcb5-4cd8-939a-e81b5e2cec11): created successfully Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1364813-0a9e-4185-8511-99a26d83e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (297da5f0-e9ec-4319-841b-e6d404dca4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fb83b770-85c3-4f75-b9cb-1c91442d0ad1 tempest-CreateVolumesFromImageTest-521237859 None] Created volume successfully. Jul 10 07:59:12 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11" returned: 0 in 1.221s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:12 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e Jul 10 07:59:12 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:13 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea 1073741824" returned: 0 in 1.264s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:13 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea Jul 10 07:59:13 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:13 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e" returned: 0 in 0.987s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:13 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e Jul 10 07:59:13 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:13 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.455s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672647867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7be9e4-f20e-4eca-9037-777bb41cb3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:08Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Creating volume 0e7be9e4-f20e-4eca-9037-777bb41cb3aa {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262e17ff-411e-4dcb-ac7d-bfbd152ffd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce492c-0b0f-437f-b29c-78b95c904195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:14 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa 1073741824 Jul 10 07:59:14 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Volume volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea (b6e297d6-d2c9-4597-884c-9cbc07f0c7ea): created successfully Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce492c-0b0f-437f-b29c-78b95c904195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (67e7be00-da8e-44d6-ab94-9988f6137768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03165bdd-0309-4eaa-891b-c49c376e7e6d tempest-CreateVolumesFromImageTest-521237859 None] Created volume successfully. Jul 10 07:59:14 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11.dd4e1530-de10-4b0c-94b6-bfd19b323d6e" returned: 0 in 0.893s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-dd4e1530-de10-4b0c-94b6-bfd19b323d6e" released by "_delete_snapshot" :: held 4.385s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" released by "delete_snapshot" :: held 4.419s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['3d062436-5afd-48dc-83db-e44360854bd7', '11b33271-b3a2-4092-93d1-44db7eb7d9b7', '1e2d02fd-a55d-4d94-9b8b-5ea17443eb0f', '5041481b-9f08-4298-b919-0107141efaaa'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Delete snapshot completed successfully. Jul 10 07:59:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-454516d2-c096-4a0d-9a24-05746f96287a tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-dd4e1530-de10-4b0c-94b6-bfd19b323d6e-delete_snapshot" released by "delete_snapshot" :: held 4.610s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:15 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa 1073741824" returned: 0 in 1.225s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:15 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa Jul 10 07:59:15 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-c29ab876-af4b-4a57-9b2d-f6f379a92f11-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-c29ab876-af4b-4a57-9b2d-f6f379a92f11-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf6612-7bf5-4921-aceb-4dc09a12021f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:15 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 Jul 10 07:59:15 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:16 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" returned: 0 in 0.917s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224101738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c874bd2e-02a0-41ff-8ea8-b971304b1eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c6fc9ef488489f8f6a51c52192cb81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:09Z,use_quota=True,user_id='d4bd6b07c197439fa2baef0c71189664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Creating volume c874bd2e-02a0-41ff-8ea8-b971304b1eb1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c33e6a7-5c3d-4b15-aa44-53e8b7433515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 1073741824 Jul 10 07:59:16 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03f535-91d7-47ff-8708-602696a262cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Volume volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa (0e7be9e4-f20e-4eca-9037-777bb41cb3aa): created successfully Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03f535-91d7-47ff-8708-602696a262cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (c8fed0dc-c08d-422d-b7c0-5e23d4832d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a1681616-383a-49dd-8ea1-c06b82b2b09a tempest-CreateVolumesFromImageTest-521237859 None] Created volume successfully. Jul 10 07:59:16 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11" returned: 0 in 0.960s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:16 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11 Jul 10 07:59:16 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Flow 'volume_create_manager' (f5456a04-709d-484a-9d6a-d99180189af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce90d244-ed1b-4e1f-a2d3-fe374c4d1b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce90d244-ed1b-4e1f-a2d3-fe374c4d1b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2026359241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5457af-7831-4028-b167-2d4a60885490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087f543457d64225afac19e6281060bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:17Z,use_quota=True,user_id='34bfddeff2414ff69329e7bb3a30f374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c2b212-6ed5-436d-8d79-f231ea097179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c2b212-6ed5-436d-8d79-f231ea097179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e240c99f-ffed-4724-9ced-067014471d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e240c99f-ffed-4724-9ced-067014471d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5457af-7831-4028-b167-2d4a60885490', 'volume_name': 'volume-ec5457af-7831-4028-b167-2d4a60885490', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79345bd9-612f-4642-a58a-a83740fe0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79345bd9-612f-4642-a58a-a83740fe0867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cb406-cedd-4392-b92a-d55f6388a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Volume ec5457af-7831-4028-b167-2d4a60885490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5457af-7831-4028-b167-2d4a60885490', 'volume_size': 1} Jul 10 07:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:17 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c29ab876-af4b-4a57-9b2d-f6f379a92f11" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:17 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 1073741824" returned: 0 in 1.169s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-quobyte-c29ab876-af4b-4a57-9b2d-f6f379a92f11" released by "delete_volume" :: held 1.752s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:17 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 Jul 10 07:59:17 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Created reservations ['734bb2a7-bea9-48fe-96e0-bc4a7b46cb4a', '3fe5b33a-ca94-477b-925f-b95116acfdb4', 'c47292c0-07da-42ed-bad9-c9e1bf468a50', 'a26d1041-d03c-43bf-ad75-5ce14414f6e0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:17 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:17 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:18 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2026359241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5457af-7831-4028-b167-2d4a60885490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087f543457d64225afac19e6281060bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:17Z,use_quota=True,user_id='34bfddeff2414ff69329e7bb3a30f374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Creating volume ec5457af-7831-4028-b167-2d4a60885490 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:18 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:18 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 1073741824 Jul 10 07:59:18 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524f1f18-ab56-4b0c-81a5-bc515fd1d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e04c1-52f3-4a5e-b208-45534fbdb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Volume volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 (c874bd2e-02a0-41ff-8ea8-b971304b1eb1): created successfully Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e04c1-52f3-4a5e-b208-45534fbdb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Flow 'volume_create_manager' (d98f7efd-ea45-4d26-ba49-883398418aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a252266f-27ec-49c2-bc2c-a863399dec8f tempest-CreateVolumesFromImageTest-521237859 None] Created volume successfully. Jul 10 07:59:18 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.941s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Deleted volume successfully. Jul 10 07:59:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-814fe5cc-88c0-4926-9f54-2fc780634a4c tempest-CreateVolumesFromSnapshotTest-1486406392 None] Lock "cinder-c29ab876-af4b-4a57-9b2d-f6f379a92f11-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-c874bd2e-02a0-41ff-8ea8-b971304b1eb1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-c874bd2e-02a0-41ff-8ea8-b971304b1eb1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-quobyte-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a3ee8-be67-4ef9-921a-a9e1ea2e489c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:19 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 1073741824" returned: 0 in 1.070s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:19 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 Jul 10 07:59:19 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:19 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 Jul 10 07:59:19 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:20 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490" returned: 0 in 0.890s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0cb406-cedd-4392-b92a-d55f6388a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5457af-7831-4028-b167-2d4a60885490', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b56de69-b089-41f3-bbda-26034fc71126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Volume volume-ec5457af-7831-4028-b167-2d4a60885490 (ec5457af-7831-4028-b167-2d4a60885490): created successfully Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b56de69-b089-41f3-bbda-26034fc71126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:20 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Flow 'volume_create_manager' (f5456a04-709d-484a-9d6a-d99180189af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" returned: 0 in 1.146s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1e98a662-b8ca-4a00-b6e8-50b3c3f3fb38 tempest-VolumesTransfersV357Test-1480652537 None] Created volume successfully. Jul 10 07:59:20 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1 Jul 10 07:59:20 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:21 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-c874bd2e-02a0-41ff-8ea8-b971304b1eb1" released by "delete_volume" :: held 2.071s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Created reservations ['eb9f71e6-d3f6-464c-b353-ea0bfcc36754', '69584fcf-0b9a-4f9b-a1b0-9bfe096da46c', '7146ce07-2caf-44cd-bb7e-24b1fbb72e09', '294fc0c3-c184-47c6-8c82-ad2ce44a88f5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:21 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:21 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-05a753d4-5e61-40f6-86f7-ef9790394577 tempest-VolumesTransfersV357Test-435001052 None] Transfer volume completed successfully. Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Flow 'volume_create_manager' (00cb3652-1027-473c-b69c-b79f6e6bd110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4e1d0b-3d39-4ab6-b09d-5d0ffb076e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4e1d0b-3d39-4ab6-b09d-5d0ffb076e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1550412599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceae1df-9152-4fee-83a4-c63329d61d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57a108a3a1041e89fe4a6bccda673f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:22Z,use_quota=True,user_id='0f832defc1aa4d818d0ef83db75ec7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856c662-bb74-43f6-9d4f-b16f78b77eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856c662-bb74-43f6-9d4f-b16f78b77eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720c0d6f-333b-40cd-8bcb-df7f928a02b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720c0d6f-333b-40cd-8bcb-df7f928a02b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ceae1df-9152-4fee-83a4-c63329d61d92', 'volume_name': 'volume-9ceae1df-9152-4fee-83a4-c63329d61d92', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583a7ac6-b7b4-430c-bae2-8722aa811457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583a7ac6-b7b4-430c-bae2-8722aa811457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243e59af-06ee-41cc-9157-90be3b324ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Volume 9ceae1df-9152-4fee-83a4-c63329d61d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ceae1df-9152-4fee-83a4-c63329d61d92', 'volume_size': 1} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1550412599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceae1df-9152-4fee-83a4-c63329d61d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57a108a3a1041e89fe4a6bccda673f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:22Z,use_quota=True,user_id='0f832defc1aa4d818d0ef83db75ec7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Creating volume 9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:22 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:22 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Deleted volume successfully. Jul 10 07:59:22 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 1073741824 Jul 10 07:59:22 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aed651f1-58ec-46e6-9a09-3074a8d48a19 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-c874bd2e-02a0-41ff-8ea8-b971304b1eb1-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-0e7be9e4-f20e-4eca-9037-777bb41cb3aa-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-0e7be9e4-f20e-4eca-9037-777bb41cb3aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-quobyte-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85e0b6-5363-41a7-bfed-8bfe755fcb8d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:22 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa Jul 10 07:59:22 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "cinder-ec5457af-7831-4028-b167-2d4a60885490-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-ec5457af-7831-4028-b167-2d4a60885490-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "cinder-quobyte-ec5457af-7831-4028-b167-2d4a60885490" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-quobyte-ec5457af-7831-4028-b167-2d4a60885490" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f968196e-5572-4b5a-9f91-4c1a0a5b2852]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:23 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 1073741824" returned: 0 in 1.311s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:23 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:23 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 Jul 10 07:59:23 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:23 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:23 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:23 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa Jul 10 07:59:23 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:24 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-0e7be9e4-f20e-4eca-9037-777bb41cb3aa" released by "delete_volume" :: held 2.076s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Created reservations ['657bca79-cd9d-4697-a9eb-72f473784117', '425b6e7a-9205-4d27-a841-2690df6520e2', 'b7b57008-943a-4556-98fb-5764f160e2a3', '82258b04-3adf-4308-842f-61d9633806f1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:24 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490" returned: 0 in 1.143s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:24 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490 Jul 10 07:59:24 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:24 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 1.123s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] <== create_volume: return (2510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:24 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:24 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243e59af-06ee-41cc-9157-90be3b324ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceae1df-9152-4fee-83a4-c63329d61d92', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0678145-0dcb-4d9d-9f72-8b660d5d8d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Volume volume-9ceae1df-9152-4fee-83a4-c63329d61d92 (9ceae1df-9152-4fee-83a4-c63329d61d92): created successfully Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0678145-0dcb-4d9d-9f72-8b660d5d8d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Flow 'volume_create_manager' (00cb3652-1027-473c-b69c-b79f6e6bd110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dbc95dc4-465b-402f-ac15-54dd0cb8c82d tempest-VolumeDependencyTests-331703597 None] Created volume successfully. Jul 10 07:59:25 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Deleted volume successfully. Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Creating offline snapshot 30418933-e137-4bb2-89e4-ed847cdac694 of volume 9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a97a408-aff9-4ed1-ba64-c1b4d20754b2 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-0e7be9e4-f20e-4eca-9037-777bb41cb3aa-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e789a-d51d-4165-8b87-11e484e560cb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:25 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ec5457af-7831-4028-b167-2d4a60885490" returned: 0 in 0.947s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-quobyte-ec5457af-7831-4028-b167-2d4a60885490" released by "delete_volume" :: held 2.160s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Created reservations ['89b91eb4-5c3c-46dc-b88b-2bf3a814adff', '6dd3065c-c25f-4bae-baec-9c536a5f9910', '97f98a4c-6a52-444c-b520-4ea3897496c8', 'dc05a00d-f6b2-45e9-9e79-e03bfe209bd5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:25 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:25 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:25 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:25 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-quobyte-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d69170-2c3f-48b3-9274-031c5b0c7e14]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:26 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea Jul 10 07:59:26 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:26 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Deleted volume successfully. Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2345ad41-d027-4bfe-85f4-ad8d1d5dfda4 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-ec5457af-7831-4028-b167-2d4a60885490-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:26 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:26 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 1G Jul 10 07:59:26 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:26 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" returned: 0 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:26 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea Jul 10 07:59:26 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Flow 'volume_create_manager' (6cbdbcad-9252-41f2-9b8a-7bbdd5374c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc2891d-ab9f-464c-8877-b9f4be74a224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc2891d-ab9f-464c-8877-b9f4be74a224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-707120681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de85e76c-b237-4e0b-916b-3e4fc4b724f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087f543457d64225afac19e6281060bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:27Z,use_quota=True,user_id='34bfddeff2414ff69329e7bb3a30f374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a3596f-c602-4c1b-b151-ed4b183fd43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a3596f-c602-4c1b-b151-ed4b183fd43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012763fa-682d-4126-9d8e-03d048d19379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012763fa-682d-4126-9d8e-03d048d19379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de85e76c-b237-4e0b-916b-3e4fc4b724f7', 'volume_name': 'volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972f937-87c9-41c8-9bf5-6ed1eab5eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972f937-87c9-41c8-9bf5-6ed1eab5eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0916ad-ce5c-429b-bf5d-bdd4f0b15ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Volume de85e76c-b237-4e0b-916b-3e4fc4b724f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7', 'volume_size': 1} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:27 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 1G" returned: 0 in 1.079s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ceae1df-9152-4fee-83a4-c63329d61d92 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:27 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ceae1df-9152-4fee-83a4-c63329d61d92 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:27 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:27 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea" released by "delete_volume" :: held 1.774s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Created reservations ['c3881323-e045-427e-a65d-f4575ae792d0', '0a0c3ed5-ac7b-4fc6-b847-ac2861ebceaf', '313771bc-102c-453c-a250-4da229c1ee7b', '56d59fd8-898f-49e1-a0d4-37b6a95db495'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:28 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:28 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-quobyte-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deac718-40bf-4a1f-af46-e20ecf3d8cd6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:28 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 Jul 10 07:59:28 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:28 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ceae1df-9152-4fee-83a4-c63329d61d92 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:28 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 is being set with open permissions: ugo+rw Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:28 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:28 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:28 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.832s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Deleted volume successfully. Jul 10 07:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-098cd2f9-a618-49b8-8028-990b37be268a tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-b6e297d6-d2c9-4597-884c-9cbc07f0c7ea-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:29 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (9af1b7c8-18fb-45a2-9cd6-6eecd5bad973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9d486-8213-46ee-a798-42baf218aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9d486-8213-46ee-a798-42baf218aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-406560280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afb4a87-9527-4c0b-bbac-87ff19c32004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:29Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0b0d8bb-0bc0-4863-9b81-fa0c4848c3b6),volume_type_id=b0b0d8bb-0bc0-4863-9b81-fa0c4848c3b6)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11 Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0569cb-4193-487a-9213-059bb0d7eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0569cb-4193-487a-9213-059bb0d7eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3040319-9549-4c70-a7c4-54285944f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3040319-9549-4c70-a7c4-54285944f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8afb4a87-9527-4c0b-bbac-87ff19c32004', 'volume_name': 'volume-8afb4a87-9527-4c0b-bbac-87ff19c32004', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c4d83c-3096-448b-973f-68422078ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c4d83c-3096-448b-973f-68422078ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e17ce03-b6f8-445d-805a-ef6e5d29efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume 8afb4a87-9527-4c0b-bbac-87ff19c32004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8afb4a87-9527-4c0b-bbac-87ff19c32004', 'volume_size': 1} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:29 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:29 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info Jul 10 07:59:29 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (f1b28a00-8722-4c82-b14f-ea2226cd5267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8704993-101f-4529-a1dc-4219b784dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8704993-101f-4529-a1dc-4219b784dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-266974982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234c2b5a-76aa-4e00-9ced-584175b24922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:30Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6c4ff1c-55e4-4d15-b6ca-08afaaf3849b),volume_type_id=c6c4ff1c-55e4-4d15-b6ca-08afaaf3849b)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bfeb9f-8a6d-4a4e-8359-e99eaacb27a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bfeb9f-8a6d-4a4e-8359-e99eaacb27a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73cbc71-81bb-4f35-9c44-88e7f40bfc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73cbc71-81bb-4f35-9c44-88e7f40bfc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234c2b5a-76aa-4e00-9ced-584175b24922', 'volume_name': 'volume-234c2b5a-76aa-4e00-9ced-584175b24922', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fa0637-c3b0-4483-b437-c73aa462a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fa0637-c3b0-4483-b437-c73aa462a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62873ff7-8b2b-477a-b101-45fdd7e57a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume 234c2b5a-76aa-4e00-9ced-584175b24922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234c2b5a-76aa-4e00-9ced-584175b24922', 'volume_size': 1} Jul 10 07:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:30 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11" released by "delete_volume" :: held 1.882s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:30 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:30 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info is being set with open permissions: ugo+rw Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Created reservations ['b93b6ab1-672d-4de3-9eaa-2f017c6bec61', '5202b3ab-c66f-42f7-94e0-2bde4f652ec5', '92e2eb5c-7900-45d4-9069-1af6aa62ff8e', '82f6c903-f65d-4a77-9e60-18efc867ae18'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:30 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info Jul 10 07:59:30 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:30 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:30 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (3c6f8021-6a49-4984-ac6d-86ab479297ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1096916-c82b-4bf1-b872-3a74af86f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-20b26692-1c9a-4273-a90e-71da58f1f069-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1096916-c82b-4bf1-b872-3a74af86f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1276516768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e325c796-8862-4074-8c6d-65f0f041b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:30Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1e6fec2-eec6-4466-a3a1-cb3d91555692),volume_type_id=b1e6fec2-eec6-4466-a3a1-cb3d91555692)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e05837-c021-49c1-a26c-1efc463db6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e05837-c021-49c1-a26c-1efc463db6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e0cf4-cf5c-47db-9c75-3931b5f03dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-20b26692-1c9a-4273-a90e-71da58f1f069-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "cinder-quobyte-20b26692-1c9a-4273-a90e-71da58f1f069" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-20b26692-1c9a-4273-a90e-71da58f1f069" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e1315-2f67-433e-8767-495ff8a94e04]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:30 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 Jul 10 07:59:30 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e0cf4-cf5c-47db-9c75-3931b5f03dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e325c796-8862-4074-8c6d-65f0f041b62d', 'volume_name': 'volume-e325c796-8862-4074-8c6d-65f0f041b62d', 'volume_size': 1, 'image_id': '890a3179-5c04-46f1-a020-4967afd6736c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1163329166', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c656e6fe89b434c9b067fbcdd0e3905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '890a3179-5c04-46f1-a020-4967afd6736c', 'created_at': datetime.datetime(2026, 7, 10, 5, 59, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 59, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/890a3179-5c04-46f1-a020-4967afd6736c/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81673651-e5f8-482b-83e9-144dc823f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81673651-e5f8-482b-83e9-144dc823f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede1ff92-b061-441c-85e1-53c848e9dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume e325c796-8862-4074-8c6d-65f0f041b62d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e325c796-8862-4074-8c6d-65f0f041b62d', 'volume_size': 1, 'image_id': '890a3179-5c04-46f1-a020-4967afd6736c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1163329166', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c656e6fe89b434c9b067fbcdd0e3905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '890a3179-5c04-46f1-a020-4967afd6736c', 'created_at': datetime.datetime(2026, 7, 10, 5, 59, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 59, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/890a3179-5c04-46f1-a020-4967afd6736c/file', 'properties': {}}, 'image_service': } Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Trying to clone e325c796-8862-4074-8c6d-65f0f041b62d from image 890a3179-5c04-46f1-a020-4967afd6736c at location (None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:59:30 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.info" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.431s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.429s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-707120681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de85e76c-b237-4e0b-916b-3e4fc4b724f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087f543457d64225afac19e6281060bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:27Z,use_quota=True,user_id='34bfddeff2414ff69329e7bb3a30f374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Creating volume de85e76c-b237-4e0b-916b-3e4fc4b724f7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=193,cinder:DELETE=14,cinder:SELECT=135,cinder:INSERT=45 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:59:31 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 1073741824 Jul 10 07:59:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8de1d46b-622b-4937-94b6-e2f44f46b551 tempest-VolumeDependencyTests-331703597 None] Create snapshot completed successfully Jul 10 07:59:31 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:31 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Deleted volume successfully. Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d3ae7dd-922c-4590-b5f3-87191b4a9f96 tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-0506ecf1-dcb5-4cd8-939a-e81b5e2cec11-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:31 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069" returned: 0 in 0.958s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:31 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069 Jul 10 07:59:31 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:32 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 1073741824" returned: 0 in 0.998s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:32 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 Jul 10 07:59:32 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:32 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-20b26692-1c9a-4273-a90e-71da58f1f069" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-quobyte-20b26692-1c9a-4273-a90e-71da58f1f069" released by "delete_volume" :: held 1.825s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Created reservations ['d7d8c751-99db-4bd6-b52f-511dc99e832e', '53a99bfa-8155-40d4-a3d4-f0c0ce61d178', '610f919b-b79f-4849-a131-eac7ef8017fd', 'fdebb805-ef6b-4e00-8c72-3f6e881def2e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:32 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:32 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Flow 'volume_create_manager' (42a8a4d3-62cd-4024-8db5-9870cfe277ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6f7935-5afd-407f-b4d0-a568c51915f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6f7935-5afd-407f-b4d0-a568c51915f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-291081182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52289517-8b96-4249-bffc-fa274bccc7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57a108a3a1041e89fe4a6bccda673f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30418933-e137-4bb2-89e4-ed847cdac694,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:33Z,use_quota=True,user_id='0f832defc1aa4d818d0ef83db75ec7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ecffff-41e2-4531-9521-da946e1b109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ecffff-41e2-4531-9521-da946e1b109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75cd25-aa9a-400d-bad2-5047a274eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b75cd25-aa9a-400d-bad2-5047a274eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52289517-8b96-4249-bffc-fa274bccc7b1', 'volume_name': 'volume-52289517-8b96-4249-bffc-fa274bccc7b1', 'volume_size': 1, 'snapshot_id': '30418933-e137-4bb2-89e4-ed847cdac694'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2278c6f-ef8e-4143-b53c-4e3a3c427240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2278c6f-ef8e-4143-b53c-4e3a3c427240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f89a952-8240-48dc-bd40-efa392ada3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Volume 52289517-8b96-4249-bffc-fa274bccc7b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52289517-8b96-4249-bffc-fa274bccc7b1', 'volume_size': 1, 'snapshot_id': '30418933-e137-4bb2-89e4-ed847cdac694'} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:32 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7" returned: 0 in 0.859s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-406560280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afb4a87-9527-4c0b-bbac-87ff19c32004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:29Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0b0d8bb-0bc0-4863-9b81-fa0c4848c3b6),volume_type_id=b0b0d8bb-0bc0-4863-9b81-fa0c4848c3b6)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Creating volume 8afb4a87-9527-4c0b-bbac-87ff19c32004 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:32 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:32 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 1073741824 Jul 10 07:59:32 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0916ad-ce5c-429b-bf5d-bdd4f0b15ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a99e4a8-37a6-401e-87a3-d8159ddb23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Volume volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 (de85e76c-b237-4e0b-916b-3e4fc4b724f7): created successfully Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a99e4a8-37a6-401e-87a3-d8159ddb23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Flow 'volume_create_manager' (6cbdbcad-9252-41f2-9b8a-7bbdd5374c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-25c47074-34bb-4b5b-b5f4-b5a03b24c570 tempest-VolumesTransfersV357Test-1480652537 None] Created volume successfully. Jul 10 07:59:33 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.897s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Deleted volume successfully. Jul 10 07:59:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9da507b-2e80-4ebe-a631-735c42f9d9ce tempest-CreateVolumesFromImageTest-521237859 None] Lock "cinder-20b26692-1c9a-4273-a90e-71da58f1f069-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:34 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 1073741824" returned: 0 in 1.141s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:34 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 Jul 10 07:59:34 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "cinder-de85e76c-b237-4e0b-916b-3e4fc4b724f7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-de85e76c-b237-4e0b-916b-3e4fc4b724f7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "cinder-quobyte-de85e76c-b237-4e0b-916b-3e4fc4b724f7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-quobyte-de85e76c-b237-4e0b-916b-3e4fc4b724f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53d41c-53b4-48c7-b226-ee6bd2e64d13]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:34 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 Jul 10 07:59:34 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:34 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD, size 20.69 MB, duration 4.17 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:59:34 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Image download 20.69 MB at 4.96 MB/s Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004" returned: 0 in 0.849s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.196s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-266974982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234c2b5a-76aa-4e00-9ced-584175b24922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:30Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6c4ff1c-55e4-4d15-b6ca-08afaaf3849b),volume_type_id=c6c4ff1c-55e4-4d15-b6ca-08afaaf3849b)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Creating volume 234c2b5a-76aa-4e00-9ced-584175b24922 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:34 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e17ce03-b6f8-445d-805a-ef6e5d29efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afb4a87-9527-4c0b-bbac-87ff19c32004', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd082e25-8a08-46b3-8326-b9159472db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:35 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 1073741824 Jul 10 07:59:35 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f214ae-9d01-48c6-978c-1ca17ee0feeb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 (8afb4a87-9527-4c0b-bbac-87ff19c32004): created successfully Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd082e25-8a08-46b3-8326-b9159472db56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (9af1b7c8-18fb-45a2-9cd6-6eecd5bad973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bebf9c64-f423-4297-bd75-58fe23985097 tempest-TestInstancesWithCinderVolumes-1015113079 None] Created volume successfully. Jul 10 07:59:35 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD Jul 10 07:59:35 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:35 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7" returned: 0 in 0.925s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:35 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7 Jul 10 07:59:35 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:35 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:35 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Temporary image 890a3179-5c04-46f1-a020-4967afd6736c is fetched for user a96a4e2cdc554fd7a06924689e73ec56. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[971b7fd6-a4a8-4452-8834-0484b381787a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:36 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 1073741824" returned: 0 in 1.116s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:36 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de85e76c-b237-4e0b-916b-3e4fc4b724f7" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-quobyte-de85e76c-b237-4e0b-916b-3e4fc4b724f7" released by "delete_volume" :: held 1.780s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:36 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD Jul 10 07:59:36 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:36 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 Jul 10 07:59:36 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Created reservations ['fab75246-b8d3-48ef-abe7-96d4f391cf28', 'fe7ed189-de06-4aec-aed0-21bc89b0222f', 'd47a5e6e-5e0f-4b12-a9d6-54013063a5a8', '3914fd33-9bbf-4ea9-85d9-0c66ac4902b8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:36 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:36 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Flow 'volume_create_manager' (1bff5d78-05f1-48ed-8e74-c6bb75548b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270e1368-53ef-40de-8d89-e808431dc960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270e1368-53ef-40de-8d89-e808431dc960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e1fbf0-02b7-48d3-8ddf-cadca430891a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429075c9f0764bee961ac5d060d88cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:36Z,use_quota=True,user_id='35fde452ba1d4e018ac39489a1bada98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cfdb0f-d1c4-4635-ab46-26aef2e36bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cfdb0f-d1c4-4635-ab46-26aef2e36bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2aa8b8-137e-4d1d-996f-a68f75f09615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:36 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:36 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2aa8b8-137e-4d1d-996f-a68f75f09615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e1fbf0-02b7-48d3-8ddf-cadca430891a', 'volume_name': 'volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326b258-3340-46ba-8407-547adbd507d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326b258-3340-46ba-8407-547adbd507d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5c5400-d006-4574-8242-a755333eb300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Volume 54e1fbf0-02b7-48d3-8ddf-cadca430891a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a', 'volume_size': 1} Jul 10 07:59:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:37 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922" returned: 0 in 0.932s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.401s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694-52289517-8b96-4249-bffc-fa274bccc7b1" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:37 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62873ff7-8b2b-477a-b101-45fdd7e57a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234c2b5a-76aa-4e00-9ced-584175b24922', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1156e2-49e3-4d38-b3ed-217879d47aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694-52289517-8b96-4249-bffc-fa274bccc7b1" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Creating volume 52289517-8b96-4249-bffc-fa274bccc7b1 from snapshot 30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD" returned: 0 in 1.203s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume volume-234c2b5a-76aa-4e00-9ced-584175b24922 (234c2b5a-76aa-4e00-9ced-584175b24922): created successfully Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1156e2-49e3-4d38-b3ed-217879d47aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (f1b28a00-8722-4c82-b14f-ea2226cd5267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] snapshot: 30418933-e137-4bb2-89e4-ed847cdac694, volume: 52289517-8b96-4249-bffc-fa274bccc7b1, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:59:37 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aa5d25d0-26f2-4bdc-a7d6-b0951b0bcd6d tempest-TestInstancesWithCinderVolumes-1015113079 None] Created volume successfully. Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.950s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Deleted volume successfully. Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[881eed4e-fe40-4282-a444-e4675fd6d48f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a78b19f-949a-42a8-8b54-9a05843efc24 tempest-VolumesTransfersV357Test-1942090457 None] Lock "cinder-de85e76c-b237-4e0b-916b-3e4fc4b724f7-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:37 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:59:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:59:37 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:37 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:38 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ceae1df-9152-4fee-83a4-c63329d61d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f736a4-9a38-4eb1-b932-2892d00d1cd4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:38 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:38 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:38 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:38 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 Jul 10 07:59:38 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:44 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1" returned: 0 in 5.533s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fdcfe3-8bac-4f6b-b297-8730ef4314be]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:44 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:44 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Flow 'volume_create_manager' (96caa39c-f73a-4062-a099-f786f99ea2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b59924e-4767-456f-b421-f923f1918111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b59924e-4767-456f-b421-f923f1918111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1404705336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f8999-7ec5-4395-9de9-0d6d8b07ede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbd1ba1d6284494a6dab1f8fff63a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:45Z,use_quota=True,user_id='37b3e3153b7f4f9f945cbb88e8aaae2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c6aa76-5214-4328-9c3e-d07f79711efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c6aa76-5214-4328-9c3e-d07f79711efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1fdbe5-ab91-4ae2-b0b6-6c7d18f11b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:44 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1fdbe5-ab91-4ae2-b0b6-6c7d18f11b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e6f8999-7ec5-4395-9de9-0d6d8b07ede8', 'volume_name': 'volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a9c56-2d97-4024-804b-43db8a4b8e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a9c56-2d97-4024-804b-43db8a4b8e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e533b0a-f381-423a-96ff-2d504cc42d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Trying to clone 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:59:45 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Image download 20.69 MB at 20.69 MB/s Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a290ad-1e3f-44b7-9300-3e80f2fd60a3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:45 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 1.015s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:59:45 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Converted 1024.00 MB image at 185.03 MB/s Jul 10 07:59:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 is being set with open permissions: ugo+rw Jul 10 07:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:45 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 Jul 10 07:59:45 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:45 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD Jul 10 07:59:45 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:46 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" released by "_copy_volume_from_snapshot" :: held 8.952s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694-52289517-8b96-4249-bffc-fa274bccc7b1" released by "_create_volume_from_snapshot" :: held 9.011s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.075s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.671s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e1fbf0-02b7-48d3-8ddf-cadca430891a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429075c9f0764bee961ac5d060d88cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:36Z,use_quota=True,user_id='35fde452ba1d4e018ac39489a1bada98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Creating volume 54e1fbf0-02b7-48d3-8ddf-cadca430891a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:46 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 is fetched for user 37b3e3153b7f4f9f945cbb88e8aaae2e. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:59:46 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a 1073741824 Jul 10 07:59:46 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f89a952-8240-48dc-bd40-efa392ada3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52289517-8b96-4249-bffc-fa274bccc7b1', 'volume_size': 1, 'snapshot_id': '30418933-e137-4bb2-89e4-ed847cdac694'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de66be3-6485-4ee2-bf58-4fefcf94953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Volume volume-52289517-8b96-4249-bffc-fa274bccc7b1 (52289517-8b96-4249-bffc-fa274bccc7b1): created successfully Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de66be3-6485-4ee2-bf58-4fefcf94953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Flow 'volume_create_manager' (42a8a4d3-62cd-4024-8db5-9870cfe277ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-579502cb-7a64-4bf6-9fdd-7d2180f4350b tempest-VolumeDependencyTests-331703597 None] Created volume successfully. Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f7ec2-ea91-4152-9aec-574205ac72ea]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:46 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD Jul 10 07:59:46 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-30418933-e137-4bb2-89e4-ed847cdac694-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-30418933-e137-4bb2-89e4-ed847cdac694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Deleting offline snapshot 30418933-e137-4bb2-89e4-ed847cdac694 of volume 9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] snapshot_file for this snap is: volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[673dbed0-4cd2-4485-8b52-9cc3d8a7c44d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:47 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:47 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:47 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a 1073741824" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:47 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:47 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a Jul 10 07:59:47 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:47 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ceae1df-9152-4fee-83a4-c63329d61d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:59:47 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad528f8-329b-4d91-a46a-0b0f451a0d4a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.626s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1276516768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e325c796-8862-4074-8c6d-65f0f041b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c656e6fe89b434c9b067fbcdd0e3905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:30Z,use_quota=True,user_id='a96a4e2cdc554fd7a06924689e73ec56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1e6fec2-eec6-4466-a3a1-cb3d91555692),volume_type_id=b1e6fec2-eec6-4466-a3a1-cb3d91555692)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Creating volume e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:47 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:47 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1073741824 Jul 10 07:59:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5c5400-d006-4574-8242-a755333eb300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74d92a6-9b95-4970-9a65-f4c8bed6fab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Volume volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a (54e1fbf0-02b7-48d3-8ddf-cadca430891a): created successfully Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74d92a6-9b95-4970-9a65-f4c8bed6fab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Flow 'volume_create_manager' (1bff5d78-05f1-48ed-8e74-c6bb75548b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d94c1727-2eda-43e2-89c3-c97cd059d3c5 tempest-CinderUnicodeTest-2130209250 None] Created volume successfully. Jul 10 07:59:47 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:47 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:48 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:48 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:48 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:48 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1073741824" returned: 0 in 0.895s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:48 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 07:59:48 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Flow 'volume_create_manager' (0dc3c947-68fa-4e5d-8598-a6feb7179ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb7135e-6b00-45bc-8fc4-61a5de3e8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb7135e-6b00-45bc-8fc4-61a5de3e8b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-894447646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970be779-60d8-4907-bd15-0bef8f48a2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429075c9f0764bee961ac5d060d88cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:49Z,use_quota=True,user_id='35fde452ba1d4e018ac39489a1bada98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146ec0bc-3cc1-434c-a3d1-8a2bb5836d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146ec0bc-3cc1-434c-a3d1-8a2bb5836d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d710a281-4060-4a09-a946-46816757103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d710a281-4060-4a09-a946-46816757103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970be779-60d8-4907-bd15-0bef8f48a2f0', 'volume_name': 'volume-970be779-60d8-4907-bd15-0bef8f48a2f0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a40029-8872-4de5-b553-e5e02eb85fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a40029-8872-4de5-b553-e5e02eb85fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac0404-7df4-497a-9fe5-0395ac31e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Volume 970be779-60d8-4907-bd15-0bef8f48a2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970be779-60d8-4907-bd15-0bef8f48a2f0', 'volume_size': 1} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:49 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:49 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 0.710s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:49 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694 Jul 10 07:59:49 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.338s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1404705336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6f8999-7ec5-4395-9de9-0d6d8b07ede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbd1ba1d6284494a6dab1f8fff63a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:45Z,use_quota=True,user_id='37b3e3153b7f4f9f945cbb88e8aaae2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Creating volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:49 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1073741824 Jul 10 07:59:49 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=178,cinder:DELETE=20,cinder:SELECT=129,cinder:INSERT=52 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Attempting download of 890a3179-5c04-46f1-a020-4967afd6736c ((None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}])) to volume e325c796-8862-4074-8c6d-65f0f041b62d. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[77667969-71c9-4bef-8298-fe3632ec4ba4]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:49 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu Jul 10 07:59:49 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:50 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92.30418933-e137-4bb2-89e4-ed847cdac694" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-30418933-e137-4bb2-89e4-ed847cdac694" released by "_delete_snapshot" :: held 3.324s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" released by "delete_snapshot" :: held 3.350s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Created reservations ['1f8e1b0f-ef45-48a3-bb26-58a345ad0fd3', '17869a83-cad5-4c3f-948c-bace3694751a', '1006bd67-7dbe-4f22-b5f9-db395068eeea', 'b465d493-cbc6-4147-b472-b316990e7028'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:50 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1073741824" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:50 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Delete snapshot completed successfully. Jul 10 07:59:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f126ecec-ca7f-498f-929c-d936267623f5 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-30418933-e137-4bb2-89e4-ed847cdac694-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:50 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 07:59:50 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:50 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu Jul 10 07:59:50 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:51 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.052s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:59:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-894447646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970be779-60d8-4907-bd15-0bef8f48a2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429075c9f0764bee961ac5d060d88cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:59:49Z,use_quota=True,user_id='35fde452ba1d4e018ac39489a1bada98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Creating volume 970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:59:51 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:51 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 1073741824 Jul 10 07:59:51 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Attempting download of 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:59:51 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu" returned: 1 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_890a3179-5c04-46f1-a020-4967afd6736c_0n1xg_gu' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36d55d-282d-497f-b02a-c291bcd6eb4a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-9ceae1df-9152-4fee-83a4-c63329d61d92-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "cinder-9ceae1df-9152-4fee-83a4-c63329d61d92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f25a4-802b-422b-b2f5-4b8975204fa5]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:51 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD Jul 10 07:59:51 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a977b0d3-fdd9-424d-9282-f2e3dbc46d74]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:51 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32 Jul 10 07:59:51 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:51 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:51 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:52 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] 890a3179-5c04-46f1-a020-4967afd6736c was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:52 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 07:59:52 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:52 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32" returned: 0 in 0.995s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:52 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 1073741824" returned: 0 in 1.163s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:52 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:52 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92 Jul 10 07:59:52 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:52 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32 Jul 10 07:59:52 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:52 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 Jul 10 07:59:52 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:53 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32" returned: 1 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_3sbg2w32' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d952a770-56d8-46ae-b353-534c3c05e218]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:53 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9ceae1df-9152-4fee-83a4-c63329d61d92" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-9ceae1df-9152-4fee-83a4-c63329d61d92" released by "delete_volume" :: held 1.836s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:53 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0" returned: 0 in 0.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac0404-7df4-497a-9fe5-0395ac31e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970be779-60d8-4907-bd15-0bef8f48a2f0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d9998b-8140-4339-b96e-d02d86025ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:53 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD Jul 10 07:59:53 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Created reservations ['7c5a11fc-cf1b-45c3-9d8b-6996fd06f949', '064d6395-217e-4cde-a050-f369cc5c5cc3', '6162cd17-b448-4799-b8cb-fa9ee95cb425', '98f3b9b1-4bf4-49e7-95bc-b7bff0bfa3d3'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Volume volume-970be779-60d8-4907-bd15-0bef8f48a2f0 (970be779-60d8-4907-bd15-0bef8f48a2f0): created successfully Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d9998b-8140-4339-b96e-d02d86025ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Flow 'volume_create_manager' (0dc3c947-68fa-4e5d-8598-a6feb7179ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-01413492-b3c3-41cd-bd29-f55e403dd1c7 tempest-CinderUnicodeTest-2130209250 None] Created volume successfully. Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:53 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:53 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-52289517-8b96-4249-bffc-fa274bccc7b1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-52289517-8b96-4249-bffc-fa274bccc7b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa0e62d-f10b-4019-affb-73119789952c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:53 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 Jul 10 07:59:53 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:53 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:54 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 07:59:54 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:54 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.004s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Deleted volume successfully. Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c3738bcb-46aa-4830-90af-54023a44a6fd tempest-VolumeDependencyTests-331703597 None] Lock "cinder-9ceae1df-9152-4fee-83a4-c63329d61d92-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:54 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1" returned: 0 in 0.879s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:54 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 2.350s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_890a3179-5c04-46f1-a020-4967afd6736c_6uw_9p4tdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:59:54 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Converted 112.00 MB image at 47.61 MB/s Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:54 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1 Jul 10 07:59:54 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:54 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1G Jul 10 07:59:54 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Creating offline snapshot 1389d019-1ca8-489c-867e-9df78a1e8e2e of volume 970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ee1fb-77fe-4872-9e0e-88d48187562d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:54 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 Jul 10 07:59:54 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:55 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-52289517-8b96-4249-bffc-fa274bccc7b1" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-quobyte-52289517-8b96-4249-bffc-fa274bccc7b1" released by "delete_volume" :: held 1.739s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:55 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d 1G" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Created reservations ['98bdd8d6-1de2-4a11-8d8a-9205e2b8eeb3', 'ea051bfa-84b1-4e07-9d1d-18988e30e4f1', 'e7bc6275-9c61-4b77-87d0-0db2947e8c8b', 'b4d7598f-e43f-44db-9eff-90975f72a5a5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[69943321-f364-4f4f-8036-a60011547c90]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:55 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 07:59:55 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:55 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 07:59:55 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:55 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0" returned: 0 in 1.166s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:55 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e 1G Jul 10 07:59:55 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:56 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 2.361s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bc87e1f-1cb0-4ae7-93b3-08985100bc61_d4mpxwigdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:59:56 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Converted 112.00 MB image at 47.41 MB/s Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:56 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:56 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1G Jul 10 07:59:56 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:56 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.972s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:59:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Deleted volume successfully. Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46734951-76a6-448d-9936-8ac58f3fccb9 tempest-VolumeDependencyTests-331703597 None] Lock "cinder-52289517-8b96-4249-bffc-fa274bccc7b1-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:59:56 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 07:59:56 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:56 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e 1G" returned: 0 in 1.049s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970be779-60d8-4907-bd15-0bef8f48a2f0 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:57 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970be779-60d8-4907-bd15-0bef8f48a2f0 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e Jul 10 07:59:57 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:57 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 1G" returned: 0 in 1.032s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:57 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 1 in 1.034s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Downloaded image 890a3179-5c04-46f1-a020-4967afd6736c ((None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}])) to volume e325c796-8862-4074-8c6d-65f0f041b62d successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Temporary image 890a3179-5c04-46f1-a020-4967afd6736c for user a96a4e2cdc554fd7a06924689e73ec56 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Marking volume e325c796-8862-4074-8c6d-65f0f041b62d as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7206fea-1057-493a-ac7e-e46cb872c7de]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Copying metadata from image 890a3179-5c04-46f1-a020-4967afd6736c to e325c796-8862-4074-8c6d-65f0f041b62d. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Creating volume glance metadata for volume e325c796-8862-4074-8c6d-65f0f041b62d backed by image 890a3179-5c04-46f1-a020-4967afd6736c with: {'image_id': '890a3179-5c04-46f1-a020-4967afd6736c', 'image_name': 'tempest-scenario-img--1163329166', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede1ff92-b061-441c-85e1-53c848e9dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e325c796-8862-4074-8c6d-65f0f041b62d', 'volume_size': 1, 'image_id': '890a3179-5c04-46f1-a020-4967afd6736c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/890a3179-5c04-46f1-a020-4967afd6736c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1163329166', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c656e6fe89b434c9b067fbcdd0e3905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '890a3179-5c04-46f1-a020-4967afd6736c', 'created_at': datetime.datetime(2026, 7, 10, 5, 59, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 59, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/890a3179-5c04-46f1-a020-4967afd6736c/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d1f35-9726-42dc-b2c8-c57de79b071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Volume volume-e325c796-8862-4074-8c6d-65f0f041b62d (e325c796-8862-4074-8c6d-65f0f041b62d): created successfully Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d1f35-9726-42dc-b2c8-c57de79b071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Flow 'volume_create_manager' (3c6f8021-6a49-4984-ac6d-86ab479297ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1dbaf0aa-7f67-4a9b-bb96-3dad29f51877 tempest-TestInstancesWithCinderVolumes-1015113079 None] Created volume successfully. Jul 10 07:59:57 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 07:59:57 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:57 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970be779-60d8-4907-bd15-0bef8f48a2f0 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:57 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e is being set with open permissions: ugo+rw Jul 10 07:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:57 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e Jul 10 07:59:57 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:58 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 0.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:58 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 07:59:58 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:58 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:58 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info Jul 10 07:59:58 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:59:59 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 1 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Downloaded image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}])) to volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Temporary image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 for user 37b3e3153b7f4f9f945cbb88e8aaae2e is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Marking volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Copying metadata from image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 to 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Creating volume glance metadata for volume 4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 backed by image 9bc87e1f-1cb0-4ae7-93b3-08985100bc61 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e533b0a-f381-423a-96ff-2d504cc42d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8', 'volume_size': 1, 'image_id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b30c138a452a4226a3da533977fce98c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bc87e1f-1cb0-4ae7-93b3-08985100bc61', 'created_at': datetime.datetime(2026, 7, 10, 5, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc87e1f-1cb0-4ae7-93b3-08985100bc61/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3c9a78-609f-484f-98ab-39039ac8e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:59:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Volume volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 (4e6f8999-7ec5-4395-9de9-0d6d8b07ede8): created successfully Jul 10 07:59:59 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3c9a78-609f-484f-98ab-39039ac8e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Flow 'volume_create_manager' (96caa39c-f73a-4062-a099-f786f99ea2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info" returned: 0 in 0.828s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:59:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info is being set with open permissions: ugo+rw Jul 10 07:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:59:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-517fa888-86a1-4c62-ae5e-938ad8f26ea8 tempest-VolumesExtendTest-1213037277 None] Created volume successfully. Jul 10 07:59:59 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info Jul 10 07:59:59 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:00 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.info" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.476s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.038s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-149599a5-f9cd-4947-b2fa-52940dc7d396 tempest-CinderUnicodeTest-2130209250 None] Create snapshot completed successfully Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1c1cba-e3f8-4744-8f3e-eaca3806a31e]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:00 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 08:00:00 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-1389d019-1ca8-489c-867e-9df78a1e8e2e-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-1389d019-1ca8-489c-867e-9df78a1e8e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:01 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-quobyte-1389d019-1ca8-489c-867e-9df78a1e8e2e" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-1389d019-1ca8-489c-867e-9df78a1e8e2e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Deleting offline snapshot 1389d019-1ca8-489c-867e-9df78a1e8e2e of volume 970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] snapshot_file for this snap is: volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c9763-0130-490e-a9b5-4f189606478c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:01 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 08:00:01 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:01 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e Jul 10 08:00:01 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:01 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 1 in 0.826s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 2G" returned: 0 in 0.080s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.798s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2385b0e6-2a52-432a-809e-6c88d45b4aac tempest-VolumesExtendTest-1213037277 None] Extend volume completed successfully. Jul 10 08:00:02 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970be779-60d8-4907-bd15-0bef8f48a2f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[020b4882-ef10-497c-bfd0-85a5fe2ff226]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:02 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 Jul 10 08:00:02 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Flow 'volume_create_manager' (f726996f-9b40-47a4-a2fd-3554ba40635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd037e45-7182-4c7a-ab26-fdb1c3f0c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd037e45-7182-4c7a-ab26-fdb1c3f0c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cb37f2-5e77-41e9-bf45-3ecb0f094579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f56642b21a940ebb5549de71a399483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:02Z,use_quota=True,user_id='2a4757ba4ddb490fb3aa48ca6c91de0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d62fa6b-904a-42d0-b58c-5dc7ce01d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d62fa6b-904a-42d0-b58c-5dc7ce01d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa1191f-fa13-4285-8706-4d013c2bc17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "cinder-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-quobyte-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa999740-fc48-4107-af0d-aec0fdaa764d]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa1191f-fa13-4285-8706-4d013c2bc17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7cb37f2-5e77-41e9-bf45-3ecb0f094579', 'volume_name': 'volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579', 'volume_size': 1, 'image_id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fafcc6caaf02c1a39a3dafac8e3adb10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f56642b21a940ebb5549de71a399483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3ac56c511fee007697b23f42a115c27bf72117c460742cf1740140db8b8a5cffda9a2fdf88a7407aefc6f6494714d7673ebd84d3f1293c5712c2cc3c5eb1696', 'id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'created_at': datetime.datetime(2026, 7, 10, 6, 0, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59ed123a-8d2f-41b9-804a-438ec66d2541/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea56da-c700-4d1f-8a60-b7a396877078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea56da-c700-4d1f-8a60-b7a396877078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab0ec9e-b0c1-4250-9da7-2b577eb4e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579', 'volume_size': 1, 'image_id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fafcc6caaf02c1a39a3dafac8e3adb10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f56642b21a940ebb5549de71a399483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3ac56c511fee007697b23f42a115c27bf72117c460742cf1740140db8b8a5cffda9a2fdf88a7407aefc6f6494714d7673ebd84d3f1293c5712c2cc3c5eb1696', 'id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'created_at': datetime.datetime(2026, 7, 10, 6, 0, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59ed123a-8d2f-41b9-804a-438ec66d2541/file', 'properties': {}}, 'image_service': } Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Trying to clone e7cb37f2-5e77-41e9-bf45-3ecb0f094579 from image 59ed123a-8d2f-41b9-804a-438ec66d2541 at location (None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 08:00:02 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 08:00:02 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:02 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 08:00:02 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Image download 0.00 MB at 0.00 MB/s Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f188ae89-743d-4d4f-abee-5505820cec2a]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:03 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0" returned: 0 in 0.872s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:03 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e Jul 10 08:00:03 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:03 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:03 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:03 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:03 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 08:00:03 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:03 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:03 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:03 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:03 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:03 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e Jul 10 08:00:03 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:04 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 1 in 0.920s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:04 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 1 in 0.803s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Temporary image 59ed123a-8d2f-41b9-804a-438ec66d2541 is fetched for user 2a4757ba4ddb490fb3aa48ca6c91de0d. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 08:00:04 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8 Jul 10 08:00:04 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:04 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0.1389d019-1ca8-489c-867e-9df78a1e8e2e" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723afea-7f0a-46d6-8d5e-a1bf5441e12d]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-1389d019-1ca8-489c-867e-9df78a1e8e2e" released by "_delete_snapshot" :: held 3.608s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" released by "delete_snapshot" :: held 3.649s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Created reservations ['ace17426-aaca-44c2-907d-c74468cb829d', 'dc158db2-7002-4ded-a81e-8e264847a0a9', '516a4d4b-528e-4fc0-b6ea-6a9eff82ef66', '38739c8c-9bb5-4f5f-ba73-f1abfd994f70'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Delete snapshot completed successfully. Jul 10 08:00:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-17544516-1115-44c3-905d-e1b92bc84f17 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-1389d019-1ca8-489c-867e-9df78a1e8e2e-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:04 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:04 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:05 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-970be779-60d8-4907-bd15-0bef8f48a2f0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-970be779-60d8-4907-bd15-0bef8f48a2f0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8" released by "delete_volume" :: held 2.601s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab91cf97-4a84-4b1a-9ca8-90fa6cf97373]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Created reservations ['e4636f97-5c0f-47a5-b3d7-b719b454de7b', '6e72f73c-de9b-4253-a2d4-577fca2449ec', '389fe203-51e9-4e6a-a386-1d1d19dde00b', '96c17815-7c4d-4e33-9b4b-ca761f45df59'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:05 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 Jul 10 08:00:05 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:05 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:05 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:05 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 0 in 1.141s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:06 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:06 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[86577121-e88a-4136-bd80-04acab28350d]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:06 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0" returned: 0 in 1.263s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:06 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0 Jul 10 08:00:06 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:06 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 08:00:06 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:07 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.457s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Deleted volume successfully. Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a47be097-031f-4452-9713-3c6b3fd4cc28 tempest-VolumesExtendTest-1213037277 None] Lock "cinder-4e6f8999-7ec5-4395-9de9-0d6d8b07ede8-delete_volume" released by "delete_volume" :: held 4.450s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:00:07 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Flow 'volume_create_manager' (340115ab-6674-4ad0-b86a-d4e975d42e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c7e91-4be8-446e-bd0f-66e1e2e948c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 1 in 1.437s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c7e91-4be8-446e-bd0f-66e1e2e948c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-386341052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869f6140-706b-4757-b6a4-f5eba73ffc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbd1ba1d6284494a6dab1f8fff63a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:07Z,use_quota=True,user_id='37b3e3153b7f4f9f945cbb88e8aaae2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e79f2b3-e321-436d-a671-78320a5be88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e79f2b3-e321-436d-a671-78320a5be88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04a0398-554d-433f-b675-87d9bbc7ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04a0398-554d-433f-b675-87d9bbc7ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869f6140-706b-4757-b6a4-f5eba73ffc01', 'volume_name': 'volume-869f6140-706b-4757-b6a4-f5eba73ffc01', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d72cf31-6602-4c8c-81db-a9b2411d8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d72cf31-6602-4c8c-81db-a9b2411d8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c59a6ea-906b-4f70-bbe1-27bd0a310588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Volume 869f6140-706b-4757-b6a4-f5eba73ffc01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869f6140-706b-4757-b6a4-f5eba73ffc01', 'volume_size': 1} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:07 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-970be779-60d8-4907-bd15-0bef8f48a2f0" returned: 0 in 0.994s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-970be779-60d8-4907-bd15-0bef8f48a2f0" released by "delete_volume" :: held 2.347s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:07 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Created reservations ['3e0c2db5-71bd-4922-aeda-ffc6ff22d927', '954bb5fc-9231-4e54-95fe-c57f68111189', '13857aa8-f793-4417-81a9-23cd032ed23d', '218340ba-e85c-43de-aa18-f679626d8717'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 1.227s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:07 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 08:00:07 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:07 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:07 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-54e1fbf0-02b7-48d3-8ddf-cadca430891a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-54e1fbf0-02b7-48d3-8ddf-cadca430891a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "cinder-quobyte-54e1fbf0-02b7-48d3-8ddf-cadca430891a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-54e1fbf0-02b7-48d3-8ddf-cadca430891a" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45e593-9ee8-420e-ae9f-42707f1a3473]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:08 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a Jul 10 08:00:08 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:08 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.740s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Deleted volume successfully. Jul 10 08:00:08 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 1 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.162s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cb37f2-5e77-41e9-bf45-3ecb0f094579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f56642b21a940ebb5549de71a399483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:02Z,use_quota=True,user_id='2a4757ba4ddb490fb3aa48ca6c91de0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Creating volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:00:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-706ed0c4-6f4a-49c7-9aa1-e798b528ab39 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-970be779-60d8-4907-bd15-0bef8f48a2f0-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:08 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1073741824 Jul 10 08:00:08 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-e325c796-8862-4074-8c6d-65f0f041b62d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5556fce-6d6c-4b1c-a801-7d11cff1ba9e', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:00:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-b62273cc-c314-49d8-b682-bb4d29bd1238 req-ba7ed92f-3e00-462a-a4e7-a2038c0dfd2d tempest-TestInstancesWithCinderVolumes-1015113079 None] attachment_update completed successfully. Jul 10 08:00:08 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:09 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a Jul 10 08:00:09 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:09 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1073741824" returned: 0 in 0.849s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:09 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:09 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:09 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-54e1fbf0-02b7-48d3-8ddf-cadca430891a" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-quobyte-54e1fbf0-02b7-48d3-8ddf-cadca430891a" released by "delete_volume" :: held 1.682s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Created reservations ['0e84d652-67d4-4eb8-a2f1-7853d8600f83', '6da1f4ee-55a7-48bf-9d14-a820379efff1', '4ea45147-45c6-4099-859d-135e2ca121c6', '994b5466-648e-4b27-b17e-238f363ab69f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:09 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:09 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:10 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 0 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-386341052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869f6140-706b-4757-b6a4-f5eba73ffc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbd1ba1d6284494a6dab1f8fff63a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:07Z,use_quota=True,user_id='37b3e3153b7f4f9f945cbb88e8aaae2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Creating volume 869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:00:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:10 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 1073741824 Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Attempting download of 59ed123a-8d2f-41b9-804a-438ec66d2541 ((None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}])) to volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 08:00:10 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff892d1-8064-48f9-8679-d38199fba231]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:10 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Deleted volume successfully. Jul 10 08:00:10 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539 Jul 10 08:00:10 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d7b7784a-81dd-41f6-ad7f-5ce076437ed6 tempest-CinderUnicodeTest-2130209250 None] Lock "cinder-54e1fbf0-02b7-48d3-8ddf-cadca430891a-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:11 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:11 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 1073741824" returned: 0 in 1.153s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:11 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539 Jul 10 08:00:11 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:11 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:11 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:12 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539" returned: 1 in 1.069s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59ed123a-8d2f-41b9-804a-438ec66d2541_0q6i9539' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497c7b6-b7a6-468f-8466-ad34772ef2f8]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:12 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:12 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:12 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 1.116s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.342s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c59a6ea-906b-4f70-bbe1-27bd0a310588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869f6140-706b-4757-b6a4-f5eba73ffc01', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e805386f-fe98-438e-93a4-be8704b337b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Volume volume-869f6140-706b-4757-b6a4-f5eba73ffc01 (869f6140-706b-4757-b6a4-f5eba73ffc01): created successfully Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e805386f-fe98-438e-93a4-be8704b337b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Flow 'volume_create_manager' (340115ab-6674-4ad0-b86a-d4e975d42e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4356f060-b4d7-449e-b355-be7de18d4979 tempest-VolumesExtendTest-1213037277 None] Created volume successfully. Jul 10 08:00:13 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 0 in 1.053s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:13 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD Jul 10 08:00:13 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Creating offline snapshot d0f217a8-c6cc-495d-ba87-f96c381b1ad7 of volume 869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a8be66-444c-4d35-83c3-fbb927f2fcb8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:14 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:14 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:14 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD" returned: 1 in 0.921s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:14 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] 59ed123a-8d2f-41b9-804a-438ec66d2541 was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 08:00:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:14 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:14 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:15 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 1.212s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:15 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 1G Jul 10 08:00:15 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:15 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 0 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:15 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59ed123a-8d2f-41b9-804a-438ec66d2541_fi3egq62devstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:00:15 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 08:00:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:15 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1G Jul 10 08:00:15 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:16 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 1G" returned: 0 in 1.419s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869f6140-706b-4757-b6a4-f5eba73ffc01 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:16 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869f6140-706b-4757-b6a4-f5eba73ffc01 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 Jul 10 08:00:16 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:16 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 1G" returned: 0 in 1.375s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31e54f-0a97-4dde-9dbb-1a70d8bf43cd]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:17 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:17 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:17 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869f6140-706b-4757-b6a4-f5eba73ffc01 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7" returned: 0 in 1.298s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:17 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 is being set with open permissions: ugo+rw Jul 10 08:00:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:17 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 Jul 10 08:00:17 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:18 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 0 in 1.067s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:18 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:18 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:19 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7" returned: 0 in 1.302s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:19 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info Jul 10 08:00:19 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:19 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 1 in 1.569s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Downloaded image 59ed123a-8d2f-41b9-804a-438ec66d2541 ((None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}])) to volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Temporary image 59ed123a-8d2f-41b9-804a-438ec66d2541 for user 2a4757ba4ddb490fb3aa48ca6c91de0d is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Marking volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Copying metadata from image 59ed123a-8d2f-41b9-804a-438ec66d2541 to e7cb37f2-5e77-41e9-bf45-3ecb0f094579. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Creating volume glance metadata for volume e7cb37f2-5e77-41e9-bf45-3ecb0f094579 backed by image 59ed123a-8d2f-41b9-804a-438ec66d2541 with: {'image_id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fafcc6caaf02c1a39a3dafac8e3adb10', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab0ec9e-b0c1-4250-9da7-2b577eb4e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579', 'volume_size': 1, 'image_id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59ed123a-8d2f-41b9-804a-438ec66d2541', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fafcc6caaf02c1a39a3dafac8e3adb10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f56642b21a940ebb5549de71a399483', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3ac56c511fee007697b23f42a115c27bf72117c460742cf1740140db8b8a5cffda9a2fdf88a7407aefc6f6494714d7673ebd84d3f1293c5712c2cc3c5eb1696', 'id': '59ed123a-8d2f-41b9-804a-438ec66d2541', 'created_at': datetime.datetime(2026, 7, 10, 6, 0, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59ed123a-8d2f-41b9-804a-438ec66d2541/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540251ee-cbd1-4b28-8992-febdbf4805b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Volume volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 (e7cb37f2-5e77-41e9-bf45-3ecb0f094579): created successfully Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540251ee-cbd1-4b28-8992-febdbf4805b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Flow 'volume_create_manager' (f726996f-9b40-47a4-a2fd-3554ba40635d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8cf6005e-13f4-4f5a-9ded-66c97e790c97 tempest-VolumeImageDependencyTests-590695450 None] Created volume successfully. Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Acquiring lock "cinder-e7cb37f2-5e77-41e9-bf45-3ecb0f094579-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "cinder-e7cb37f2-5e77-41e9-bf45-3ecb0f094579-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:20 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info" returned: 0 in 1.256s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info is being set with open permissions: ugo+rw Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Acquiring lock "cinder-quobyte-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:20 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info Jul 10 08:00:20 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "cinder-quobyte-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863868d-b352-4b9c-9277-40eba2df64da]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:20 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:20 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:21 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.info" returned: 0 in 1.414s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:21 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.058s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 0 in 1.259s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-91b3807b-472f-4f62-bd2d-489fd602bce1 tempest-VolumesExtendTest-1213037277 None] Create snapshot completed successfully Jul 10 08:00:22 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:22 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[329609ed-67f1-42bf-96ba-b9c390159064]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:22 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:22 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:23 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 1 in 1.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:00:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:23 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579 Jul 10 08:00:23 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:23 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 1.292s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 2G" returned: 0 in 0.235s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.601s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7a235c31-c5f8-47ad-9c12-08c2b6aea6e2 tempest-VolumesExtendTest-1213037277 None] Extend volume completed successfully. Jul 10 08:00:24 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" returned: 0 in 1.212s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "cinder-quobyte-e7cb37f2-5e77-41e9-bf45-3ecb0f094579" released by "delete_volume" :: held 4.348s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Created reservations ['73112084-141d-482f-bece-7cbf41905f7b', '7996cf99-22f0-4b54-b05d-05bd19102e1f', '5d175c65-4c8a-43ee-98b6-5910361be30a', '50691b0f-9415-4920-a444-59dee89fa961'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:25 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:25 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-d0f217a8-c6cc-495d-ba87-f96c381b1ad7-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-d0f217a8-c6cc-495d-ba87-f96c381b1ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-quobyte-d0f217a8-c6cc-495d-ba87-f96c381b1ad7" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-d0f217a8-c6cc-495d-ba87-f96c381b1ad7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Deleting offline snapshot d0f217a8-c6cc-495d-ba87-f96c381b1ad7 of volume 869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] snapshot_file for this snap is: volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67393eb-099a-4d64-ab51-7b51fbbffe79]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:25 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 Jul 10 08:00:25 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:26 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.437s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Deleted volume successfully. Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-57fb70d8-f28e-4df6-843c-612b8ffafda1 tempest-VolumeImageDependencyTests-590695450 None] Lock "cinder-e7cb37f2-5e77-41e9-bf45-3ecb0f094579-delete_volume" released by "delete_volume" :: held 6.264s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:26 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7" returned: 0 in 1.415s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869f6140-706b-4757-b6a4-f5eba73ffc01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59de2dd-4022-45b5-a572-6657e73d96ec]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:27 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:27 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:28 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 1.071s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:28 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 Jul 10 08:00:28 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:29 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7" returned: 0 in 1.162s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:29 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7 Jul 10 08:00:29 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:29 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01.d0f217a8-c6cc-495d-ba87-f96c381b1ad7" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-d0f217a8-c6cc-495d-ba87-f96c381b1ad7" released by "_delete_snapshot" :: held 4.503s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" released by "delete_snapshot" :: held 4.541s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Created reservations ['5056eae0-afcb-4b2c-b70d-2a35352ef8cd', '788af648-cf0d-4f02-a7e4-1a07300b3a4b', '4a67c39a-a33e-4ce4-a351-88e3263b5b16', 'f965dd82-aa41-4637-b105-9e9c388e991d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Delete snapshot completed successfully. Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a18e1e0-9c91-4c79-8d0b-332d702048fc tempest-VolumesExtendTest-1213037277 None] Lock "cinder-d0f217a8-c6cc-495d-ba87-f96c381b1ad7-delete_snapshot" released by "delete_snapshot" :: held 4.727s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-869f6140-706b-4757-b6a4-f5eba73ffc01-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "cinder-869f6140-706b-4757-b6a4-f5eba73ffc01-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Acquiring lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:00:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:00:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a5b811-9b19-4ca4-a03a-aefb24af36d2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:31 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:31 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:31 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:32 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01 Jul 10 08:00:32 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:32 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-869f6140-706b-4757-b6a4-f5eba73ffc01" returned: 0 in 0.718s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "cinder-quobyte-869f6140-706b-4757-b6a4-f5eba73ffc01" released by "delete_volume" :: held 1.788s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:DELETE=12,cinder:UPDATE=119,cinder:INSERT=34,cinder:SELECT=109 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Created reservations ['e631490b-9515-4068-80a4-c3b09664b769', '31e0e403-03d7-4651-a1e3-ea7876ea0f73', 'bb9239c8-a009-4f91-a3dc-368f54b69bd2', '22529a8a-c1f7-40ca-9f72-c2e822fba456'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:32 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:32 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:33 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.738s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Deleted volume successfully. Jul 10 08:00:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f3655905-d370-48c5-b53b-9fbab1cb64ee tempest-VolumesExtendTest-1213037277 None] Lock "cinder-869f6140-706b-4757-b6a4-f5eba73ffc01-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:36 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:00:36 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:37 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:00:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:00:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:00:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:00:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:INSERT=1,cinder:UPDATE=6,cinder:SELECT=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:00:43 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=89,cinder:INSERT=47,cinder:UPDATE=103,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:00:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b3fb9-875c-44ad-bbf4-24a6ed120ffe]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:44 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 Jul 10 08:00:44 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:45 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004" returned: 0 in 0.984s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-8afb4a87-9527-4c0b-bbac-87ff19c32004', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a88bcba-3e49-49f2-8279-d54ba5e8e9e2', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:00:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-518e68d5-94ec-4d21-96c8-3031afedceaf req-bf7352ef-0750-4c98-8b7f-5b77fab3abd8 tempest-TestInstancesWithCinderVolumes-1015113079 None] attachment_update completed successfully. Jul 10 08:00:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8efec1-b260-4bf8-bd0c-b7a67fa4c755]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:00:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:54 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 Jul 10 08:00:54 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:55 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922" returned: 0 in 0.928s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.956s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-234c2b5a-76aa-4e00-9ced-584175b24922', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a713fb97-5514-4895-9b60-76fe5c411018', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:00:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-bcf6bc8d-3fb2-4730-8f6c-8e069566e15b req-aa50b984-2474-4caf-8f14-9ed4560be5f2 tempest-TestInstancesWithCinderVolumes-1015113079 None] attachment_update completed successfully. Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Flow 'volume_create_manager' (499f12b0-c60e-4c42-b4d0-178873688789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806d33f9-a36f-438e-af3d-75d2b4fff42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806d33f9-a36f-438e-af3d-75d2b4fff42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1871855813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea975a0e340497c8c32129233b55ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:57Z,use_quota=True,user_id='9c108d0d1ce64feaa238dbd8d2da73af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedbe0b5-aae1-4770-9765-61281b8c2a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedbe0b5-aae1-4770-9765-61281b8c2a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e403db-7f29-4744-ae46-d1ba92d0f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e403db-7f29-4744-ae46-d1ba92d0f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2', 'volume_name': 'volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b77f169-6d3e-4acb-a8d8-c0d60a03fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b77f169-6d3e-4acb-a8d8-c0d60a03fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e48b88-1df8-4940-bdb6-97ec11a6fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Volume 3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2', 'volume_size': 1} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1871855813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea975a0e340497c8c32129233b55ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:00:57Z,use_quota=True,user_id='9c108d0d1ce64feaa238dbd8d2da73af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Creating volume 3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:00:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:00:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:57 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 1073741824 Jul 10 08:00:57 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:58 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 1073741824" returned: 0 in 1.122s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:00:58 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:00:58 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:00:59 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e48b88-1df8-4940-bdb6-97ec11a6fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac7d26-26c0-4a21-8c17-a5108a55223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:00:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Volume volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 (3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2): created successfully Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac7d26-26c0-4a21-8c17-a5108a55223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Flow 'volume_create_manager' (499f12b0-c60e-4c42-b4d0-178873688789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:00:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dd92c549-591f-4ab9-881d-3e928f187d1e tempest-SnapshotDependencyTests-548284423 None] Created volume successfully. Jul 10 08:01:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Creating offline snapshot 6c8553e4-5f57-4990-9578-145c0650c1d1 of volume 3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:01:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d0d8e-fe92-4505-9faa-1bc021bd1d45]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:01 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:01 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:02 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 1.118s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:02 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 1G Jul 10 08:01:02 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:03 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 1G" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:03 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:03 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:03 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:03 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 is being set with open permissions: ugo+rw Jul 10 08:01:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:03 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:03 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:04 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:04 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info Jul 10 08:01:04 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:05 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:05 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info is being set with open permissions: ugo+rw Jul 10 08:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:05 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info Jul 10 08:01:05 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:05 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.info" returned: 0 in 0.669s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.100s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a9f75b36-486a-4e85-b3f9-35557aaefe42 tempest-SnapshotDependencyTests-548284423 None] Create snapshot completed successfully Jul 10 08:01:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1b0a1739-dccb-4399-bd9c-42cbf937c76f req-e57cb270-d270-4ec3-bcec-7c60a86a17f3 tempest-TestInstancesWithCinderVolumes-1015113079 None] Terminate volume connection completed successfully. Jul 10 08:01:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1b0a1739-dccb-4399-bd9c-42cbf937c76f req-e57cb270-d270-4ec3-bcec-7c60a86a17f3 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleting attachment 1a88bcba-3e49-49f2-8279-d54ba5e8e9e2. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Flow 'volume_create_manager' (310ab3d3-8095-41e5-b8e7-b43436cdc0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febc81bb-a679-41ee-a0e4-1f18cfaf115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febc81bb-a679-41ee-a0e4-1f18cfaf115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8034b21-8d9c-465a-b90d-b73a59a67a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea975a0e340497c8c32129233b55ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c8553e4-5f57-4990-9578-145c0650c1d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:01:08Z,use_quota=True,user_id='9c108d0d1ce64feaa238dbd8d2da73af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a847d7-94d9-45fa-a03c-61a6cfe4e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a847d7-94d9-45fa-a03c-61a6cfe4e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e644cfab-fb7b-4d54-834b-2532a0d0e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e644cfab-fb7b-4d54-834b-2532a0d0e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8034b21-8d9c-465a-b90d-b73a59a67a46', 'volume_name': 'volume-e8034b21-8d9c-465a-b90d-b73a59a67a46', 'volume_size': 1, 'snapshot_id': '6c8553e4-5f57-4990-9578-145c0650c1d1'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc6375-f2df-492f-990e-98223999f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc6375-f2df-492f-990e-98223999f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21aa209-41ac-4d79-b2b4-bef6d8789bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Volume e8034b21-8d9c-465a-b90d-b73a59a67a46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8034b21-8d9c-465a-b90d-b73a59a67a46', 'volume_size': 1, 'snapshot_id': '6c8553e4-5f57-4990-9578-145c0650c1d1'} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1-e8034b21-8d9c-465a-b90d-b73a59a67a46" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1-e8034b21-8d9c-465a-b90d-b73a59a67a46" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Creating volume e8034b21-8d9c-465a-b90d-b73a59a67a46 from snapshot 6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] snapshot: 6c8553e4-5f57-4990-9578-145c0650c1d1, volume: e8034b21-8d9c-465a-b90d-b73a59a67a46, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b36259-1b58-4544-8f87-1003e443c49d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-8afb4a87-9527-4c0b-bbac-87ff19c32004-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-8afb4a87-9527-4c0b-bbac-87ff19c32004-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:08 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:08 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-quobyte-8afb4a87-9527-4c0b-bbac-87ff19c32004" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-8afb4a87-9527-4c0b-bbac-87ff19c32004" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afc15e-d8d7-4863-9cfc-2d77b4e96a12]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:08 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 Jul 10 08:01:08 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:09 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 1.186s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b816471-d154-4942-8192-4ec2a0104b91]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:09 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:09 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:09 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004" returned: 0 in 1.294s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:09 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004 Jul 10 08:01:09 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:10 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:10 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 Jul 10 08:01:10 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:10 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8afb4a87-9527-4c0b-bbac-87ff19c32004" returned: 0 in 0.923s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-8afb4a87-9527-4c0b-bbac-87ff19c32004" released by "delete_volume" :: held 2.276s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:10 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290256356-1216103262 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290256356-1216103262, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:10 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290256356-1216103262 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-290256356-1216103262, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Created reservations ['480c91b5-39ac-44be-93e5-809d82a19e15', 'd3e20abc-d673-4262-bb00-ae361e2c849d', 'c3d7940a-5490-441d-a56a-e2969be6f25c', 'c445777b-9995-4222-9b55-3ed02be1b014'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:10 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:10 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:11 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:11 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleted volume successfully. Jul 10 08:01:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae2df7ba-e35e-4254-8fde-919261aeb5bf tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-8afb4a87-9527-4c0b-bbac-87ff19c32004-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-5c5bdd82-bef1-4e5f-a9de-52f01152f76a req-f4914197-bac5-4365-8491-fbcf3b7e6323 tempest-TestInstancesWithCinderVolumes-1015113079 None] Terminate volume connection completed successfully. Jul 10 08:01:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-5c5bdd82-bef1-4e5f-a9de-52f01152f76a req-f4914197-bac5-4365-8491-fbcf3b7e6323 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleting attachment a713fb97-5514-4895-9b60-76fe5c411018. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-234c2b5a-76aa-4e00-9ced-584175b24922-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-234c2b5a-76aa-4e00-9ced-584175b24922-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-quobyte-234c2b5a-76aa-4e00-9ced-584175b24922" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-234c2b5a-76aa-4e00-9ced-584175b24922" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[987d731a-9ddb-4add-ba1d-59cfed493d61]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:16 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46" returned: 0 in 6.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea8d2d4-c37b-4208-823b-7ab651c8a752]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:17 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 Jul 10 08:01:17 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:17 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:17 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:17 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922" returned: 0 in 1.029s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:17 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922 Jul 10 08:01:17 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:18 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 1.252s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:18 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:01:18 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Converted 1024.00 MB image at 154.01 MB/s Jul 10 08:01:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 is being set with open permissions: ugo+rw Jul 10 08:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:18 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 Jul 10 08:01:18 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:19 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46" returned: 0 in 0.990s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" released by "_copy_volume_from_snapshot" :: held 11.277s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1-e8034b21-8d9c-465a-b90d-b73a59a67a46" released by "_create_volume_from_snapshot" :: held 11.329s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.358s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:19 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-234c2b5a-76aa-4e00-9ced-584175b24922" returned: 0 in 1.399s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-234c2b5a-76aa-4e00-9ced-584175b24922" released by "delete_volume" :: held 2.516s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21aa209-41ac-4d79-b2b4-bef6d8789bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8034b21-8d9c-465a-b90d-b73a59a67a46', 'volume_size': 1, 'snapshot_id': '6c8553e4-5f57-4990-9578-145c0650c1d1'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc04952e-c42e-45fc-bf2d-e8f5eae85238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Volume volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 (e8034b21-8d9c-465a-b90d-b73a59a67a46): created successfully Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc04952e-c42e-45fc-bf2d-e8f5eae85238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Flow 'volume_create_manager' (310ab3d3-8095-41e5-b8e7-b43436cdc0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:01:19 devstack cinder-volume[87192]: WARNING cinder.quota [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1990354284-855817816 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1990354284-855817816, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:19 devstack cinder-volume[87192]: WARNING cinder.quota [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1990354284-855817816 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1990354284-855817816, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fea443ec-0268-42b8-ad3b-a1c127f2e450 tempest-SnapshotDependencyTests-548284423 None] Created volume successfully. Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Created reservations ['0a5c62c4-6654-414b-b5f3-3465ec188352', 'e5b60564-29ae-4127-b3ff-4dbefed77e0c', '91913974-5072-4ff0-abf1-d63a38c37f8c', '49b11d41-e718-4592-9c60-e38c25e8fbc0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:19 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:19 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-6c8553e4-5f57-4990-9578-145c0650c1d1-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-6c8553e4-5f57-4990-9578-145c0650c1d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Deleting offline snapshot 6c8553e4-5f57-4990-9578-145c0650c1d1 of volume 3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] snapshot_file for this snap is: volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94517f7-b114-41da-a221-6a9a5fe2a9ea]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:20 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:20 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:20 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.238s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleted volume successfully. Jul 10 08:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c1ef998-9ede-4f25-b75e-e28358b6153a tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-234c2b5a-76aa-4e00-9ced-584175b24922-delete_volume" released by "delete_volume" :: held 4.150s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:21 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 0.995s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec33d95-a48e-49ab-8281-e832151ac184]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:21 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:21 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Flow 'volume_create_manager' (6b42982b-3ed5-4e33-b4c5-4e46a7d8095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c6bb8-1b50-44c0-a3ae-3918ade2d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c6bb8-1b50-44c0-a3ae-3918ade2d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1109260419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18715dcb-43b2-47c8-873e-57905f84ca4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afb96b0085648a79b45d572b9c1b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:01:22Z,use_quota=True,user_id='22a0b302cf0642c4b3b64ec62dc86953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d86c0-0522-4160-a128-08c7001bf7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d86c0-0522-4160-a128-08c7001bf7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf856af7-c3b9-4118-aa51-e9ba95fe08e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf856af7-c3b9-4118-aa51-e9ba95fe08e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18715dcb-43b2-47c8-873e-57905f84ca4a', 'volume_name': 'volume-18715dcb-43b2-47c8-873e-57905f84ca4a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59007cea-6d5e-439f-841b-ec3232aa8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59007cea-6d5e-439f-841b-ec3232aa8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd739e-b432-44e7-b434-9928b407557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Volume 18715dcb-43b2-47c8-873e-57905f84ca4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18715dcb-43b2-47c8-873e-57905f84ca4a', 'volume_size': 1} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1109260419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18715dcb-43b2-47c8-873e-57905f84ca4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afb96b0085648a79b45d572b9c1b496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:01:22Z,use_quota=True,user_id='22a0b302cf0642c4b3b64ec62dc86953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Creating volume 18715dcb-43b2-47c8-873e-57905f84ca4a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:01:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:01:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:21 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a 1073741824 Jul 10 08:01:21 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:22 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 1.207s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:22 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:22 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:23 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a 1073741824" returned: 0 in 1.327s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:23 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a Jul 10 08:01:23 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:24 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 1.188s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:24 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1 Jul 10 08:01:24 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:24 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd739e-b432-44e7-b434-9928b407557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18715dcb-43b2-47c8-873e-57905f84ca4a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb4f39-5c55-4858-99cb-0a1d3c41c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:01:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Volume volume-18715dcb-43b2-47c8-873e-57905f84ca4a (18715dcb-43b2-47c8-873e-57905f84ca4a): created successfully Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfb4f39-5c55-4858-99cb-0a1d3c41c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Flow 'volume_create_manager' (6b42982b-3ed5-4e33-b4c5-4e46a7d8095e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:01:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-12e9c29f-f1f3-4a18-a1c8-d489307fa1c2 tempest-TestMinimumBasicScenario-31119899 None] Created volume successfully. Jul 10 08:01:24 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2.6c8553e4-5f57-4990-9578-145c0650c1d1" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-6c8553e4-5f57-4990-9578-145c0650c1d1" released by "_delete_snapshot" :: held 4.423s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" released by "delete_snapshot" :: held 4.483s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Created reservations ['6f0db1f1-b41b-45c1-91be-ae5953299698', '2ec1ad1e-e902-452c-973d-dccf2b4fa69d', '34b86477-5e80-466d-adee-dc6e2c501597', 'c7cf4890-a53f-4208-b237-d64eef9d3815'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Delete snapshot completed successfully. Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef1782b6-0154-4d5d-bab4-40558b8670f3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-6c8553e4-5f57-4990-9578-145c0650c1d1-delete_snapshot" released by "delete_snapshot" :: held 4.774s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ae51d059-b087-4149-a802-e14e01b637ca req-7faee5e0-fd7b-42a3-8d73-b68684669894 tempest-TestInstancesWithCinderVolumes-1015113079 None] Terminate volume connection completed successfully. Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ae51d059-b087-4149-a802-e14e01b637ca req-7faee5e0-fd7b-42a3-8d73-b68684669894 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleting attachment d5556fce-6d6c-4b1c-a801-7d11cff1ba9e. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01c4ac-363d-48e6-96ff-a10ff1baada7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:26 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:26 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:26 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 0.823s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:26 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2 Jul 10 08:01:26 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:27 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2" released by "delete_volume" :: held 1.681s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Created reservations ['85ed8240-cda4-424b-9e2d-4515d89a9996', 'f1818060-1cd1-4e0a-a7da-aff3d0704f18', '9f02c77a-0993-4338-b1b6-00afa7281f12', '181f7227-a781-47cd-8373-8f9485c589fc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:27 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:27 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-e8034b21-8d9c-465a-b90d-b73a59a67a46-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-e8034b21-8d9c-465a-b90d-b73a59a67a46-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4a31b-0205-40eb-b36e-87217348c6ce]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:28 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 Jul 10 08:01:28 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef762c-7285-4a36-b86a-c025c9bd1dda]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:28 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Deleted volume successfully. Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e72c92a1-3f64-4421-8961-14a202c2fbd3 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-3fc1c185-e5d7-4cfd-adaa-a0ce1ff7c5f2-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-e325c796-8862-4074-8c6d-65f0f041b62d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-e325c796-8862-4074-8c6d-65f0f041b62d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "cinder-quobyte-e325c796-8862-4074-8c6d-65f0f041b62d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-e325c796-8862-4074-8c6d-65f0f041b62d" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:01:28 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a Jul 10 08:01:28 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02fb3e-a578-4f43-a7cc-60e06f5e29c8]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:01:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:29 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 08:01:29 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:29 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:29 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46 Jul 10 08:01:29 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:29 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a" returned: 0 in 1.167s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-18715dcb-43b2-47c8-873e-57905f84ca4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9b77b5b-a9a2-4fe7-94c6-3cd6c6a4f3c2', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:01:29 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 0.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-eedd3f00-e16c-4519-928f-01882ceba24a req-43f593f4-699a-4472-9596-f7162c8137df tempest-TestMinimumBasicScenario-31119899 None] attachment_update completed successfully. Jul 10 08:01:30 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 08:01:30 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:30 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8034b21-8d9c-465a-b90d-b73a59a67a46" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-quobyte-e8034b21-8d9c-465a-b90d-b73a59a67a46" released by "delete_volume" :: held 2.010s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Created reservations ['42714a40-bcbc-453f-9702-cc8ec725599f', 'b5a10873-c2ec-4f7b-aa02-1a23d7ec79dd', '60b760cf-332c-4ae2-beb7-0d54dffffd64', '7888f82e-6c68-48ca-9650-5f8cc356489d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:30 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:30 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:30 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 1 in 0.985s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:01:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:30 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d Jul 10 08:01:30 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:31 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Deleted volume successfully. Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f23ea1b0-c211-46bb-8f04-9dad460d27c1 tempest-SnapshotDependencyTests-548284423 None] Lock "cinder-e8034b21-8d9c-465a-b90d-b73a59a67a46-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:31 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e325c796-8862-4074-8c6d-65f0f041b62d" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-quobyte-e325c796-8862-4074-8c6d-65f0f041b62d" released by "delete_volume" :: held 2.758s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:31 devstack cinder-volume[87192]: WARNING cinder.quota [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-158039793-1187745737 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-158039793-1187745737, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:31 devstack cinder-volume[87192]: WARNING cinder.quota [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-158039793-1187745737 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-158039793-1187745737, it is now deprecated. Please use the default quota class for default quota. Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Created reservations ['a7098b0b-6d69-4ad9-826d-4a14782f119e', '1f3ee6a2-095b-4afd-b4dc-6b2e3419b46d', 'a130a0e4-26d5-4ab9-805b-f34edc154fed', '920fe841-dcfd-496a-87d1-5feeaf4064be'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:31 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:31 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:32 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.723s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:32 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Deleted volume successfully. Jul 10 08:01:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c08a4848-db87-4733-a93e-1a4eed259bc1 tempest-TestInstancesWithCinderVolumes-1015113079 None] Lock "cinder-e325c796-8862-4074-8c6d-65f0f041b62d-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:01:36 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:01:36 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:01:37 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 10 08:01:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:01:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:01:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:01:41 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=60,cinder:UPDATE=61,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:01:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=61,cinder:UPDATE=59,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Flow 'volume_create_manager' (a2605508-d8eb-4315-9b54-97d9fd82a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a57f4f-098d-4c43-be98-7b1c73d2f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a57f4f-098d-4c43-be98-7b1c73d2f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1532529167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658feffa-f7b3-49fa-b3e7-766fe8024e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f2b417d1e4f96959835a122877c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:05Z,use_quota=True,user_id='7b22dbfb11ff4819aa7642b34b9a7b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e50027-d251-4fd9-9563-5a7b41062a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e50027-d251-4fd9-9563-5a7b41062a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c7c6b0-a57e-4ebe-859a-d9409348e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c7c6b0-a57e-4ebe-859a-d9409348e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658feffa-f7b3-49fa-b3e7-766fe8024e9c', 'volume_name': 'volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1686cb5b-ede4-4863-a699-64a8cf0b26d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1686cb5b-ede4-4863-a699-64a8cf0b26d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7957c6e-011c-42d0-b819-79cb463c74f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume 658feffa-f7b3-49fa-b3e7-766fe8024e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c', 'volume_size': 1} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1532529167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658feffa-f7b3-49fa-b3e7-766fe8024e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f2b417d1e4f96959835a122877c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:05Z,use_quota=True,user_id='7b22dbfb11ff4819aa7642b34b9a7b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Creating volume 658feffa-f7b3-49fa-b3e7-766fe8024e9c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:02:05 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:05 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c 1073741824 Jul 10 08:02:05 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Flow 'volume_create_manager' (480caddf-fc42-4995-a2d2-216d94b7eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faa5aed-b94b-449c-b419-a7f965037e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faa5aed-b94b-449c-b419-a7f965037e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-569243020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ae8815-cd76-4036-8b0c-28f12f541bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f2b417d1e4f96959835a122877c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:06Z,use_quota=True,user_id='7b22dbfb11ff4819aa7642b34b9a7b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0028ed3a-0aca-491e-a459-4ff5c745b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0028ed3a-0aca-491e-a459-4ff5c745b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a60630-6fcc-40b6-8224-9a012df46b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a60630-6fcc-40b6-8224-9a012df46b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ae8815-cd76-4036-8b0c-28f12f541bc5', 'volume_name': 'volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c87125-c1f0-451d-87a0-9411acff4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c87125-c1f0-451d-87a0-9411acff4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0002b95e-7279-488c-8d3d-e1a31adf35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume b0ae8815-cd76-4036-8b0c-28f12f541bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5', 'volume_size': 1} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:06 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c 1073741824" returned: 0 in 1.069s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:06 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c Jul 10 08:02:06 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:07 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-569243020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ae8815-cd76-4036-8b0c-28f12f541bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f2b417d1e4f96959835a122877c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:06Z,use_quota=True,user_id='7b22dbfb11ff4819aa7642b34b9a7b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Creating volume b0ae8815-cd76-4036-8b0c-28f12f541bc5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:02:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7957c6e-011c-42d0-b819-79cb463c74f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c4eb07-c376-4a4c-a7f1-373176530bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:07 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 1073741824 Jul 10 08:02:07 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c (658feffa-f7b3-49fa-b3e7-766fe8024e9c): created successfully Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c4eb07-c376-4a4c-a7f1-373176530bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Flow 'volume_create_manager' (a2605508-d8eb-4315-9b54-97d9fd82a961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-88939a31-09d1-4cc0-a90b-4a5057978df8 tempest-TestServerVolumeAttachmentScenario-760845728 None] Created volume successfully. Jul 10 08:02:08 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 1073741824" returned: 0 in 0.909s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:08 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 Jul 10 08:02:08 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:09 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0002b95e-7279-488c-8d3d-e1a31adf35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7ceacd-b4b5-4e0b-abb1-3853db2d60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Volume volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 (b0ae8815-cd76-4036-8b0c-28f12f541bc5): created successfully Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7ceacd-b4b5-4e0b-abb1-3853db2d60c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Flow 'volume_create_manager' (480caddf-fc42-4995-a2d2-216d94b7eee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0c15bb6d-6643-4ad5-851e-8fae6524c336 tempest-TestServerVolumeAttachmentScenario-760845728 None] Created volume successfully. Jul 10 08:02:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:02:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:02:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-b7406043-928a-4724-a671-bab0fd061183 req-6d93eab0-af11-45b8-b843-3ce86e8d5825 tempest-TestMinimumBasicScenario-31119899 None] Terminate volume connection completed successfully. Jul 10 08:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-b7406043-928a-4724-a671-bab0fd061183 req-6d93eab0-af11-45b8-b843-3ce86e8d5825 tempest-TestMinimumBasicScenario-31119899 None] Deleting attachment b9b77b5b-a9a2-4fe7-94c6-3cd6c6a4f3c2. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "cinder-18715dcb-43b2-47c8-873e-57905f84ca4a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "cinder-18715dcb-43b2-47c8-873e-57905f84ca4a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "cinder-quobyte-18715dcb-43b2-47c8-873e-57905f84ca4a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "cinder-quobyte-18715dcb-43b2-47c8-873e-57905f84ca4a" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78b2c0f-6dc9-48ef-97ea-077599861052]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:26 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a Jul 10 08:02:26 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:26 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:26 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a Jul 10 08:02:26 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:27 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18715dcb-43b2-47c8-873e-57905f84ca4a" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "cinder-quobyte-18715dcb-43b2-47c8-873e-57905f84ca4a" released by "delete_volume" :: held 1.483s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Created reservations ['762a411f-1f1a-4571-9ab7-7ef0fe83cb41', 'c43bbbf2-40c9-4774-b29a-0d42f079715a', '45db9bd1-5444-4aea-a98f-ef5203d5a1ce', 'b9d38dc5-790a-4ebf-92e6-bd9a3a183c82'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:27 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:02:27 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:28 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:02:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Deleted volume successfully. Jul 10 08:02:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-073cf64a-7a89-4aa9-a238-ab0aa43a46bd tempest-TestMinimumBasicScenario-31119899 None] Lock "cinder-18715dcb-43b2-47c8-873e-57905f84ca4a-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:36 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:02:36 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:37 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:02:37 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:02:38 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3408f67-e03a-4224-ac80-d0b336974143]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:48 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c Jul 10 08:02:48 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:49 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c" returned: 0 in 0.804s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d04ef0a-81fc-4984-8841-e4daa56061f8', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:02:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-c395f21c-3ed9-42c1-bfd8-62afd839776b req-8d8e7c23-7581-4785-9494-69b0934a6d0d tempest-TestServerVolumeAttachmentScenario-760845728 None] attachment_update completed successfully. Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (cf359109-9f24-4e57-a616-5d8f9887a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6661951-e77a-4396-84c0-6738b593fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6661951-e77a-4396-84c0-6738b593fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1134306183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da968131-ac07-4154-8c12-d0d4dea39d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:51Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060d3740-d585-4c83-9b0d-68a5edf38c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060d3740-d585-4c83-9b0d-68a5edf38c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed959c-5173-4c95-96a7-c0f5b25f6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed959c-5173-4c95-96a7-c0f5b25f6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da968131-ac07-4154-8c12-d0d4dea39d01', 'volume_name': 'volume-da968131-ac07-4154-8c12-d0d4dea39d01', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ea762-8998-4635-8f49-454c9db2dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ea762-8998-4635-8f49-454c9db2dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc99771-2c7c-4b61-9c8c-bfd3fbd207bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Volume da968131-ac07-4154-8c12-d0d4dea39d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da968131-ac07-4154-8c12-d0d4dea39d01', 'volume_size': 1} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1134306183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da968131-ac07-4154-8c12-d0d4dea39d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:51Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Creating volume da968131-ac07-4154-8c12-d0d4dea39d01 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:02:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:50 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 1073741824 Jul 10 08:02:50 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:51 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 1073741824" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:51 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 Jul 10 08:02:51 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:52 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc99771-2c7c-4b61-9c8c-bfd3fbd207bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da968131-ac07-4154-8c12-d0d4dea39d01', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235a7bec-f16d-4721-b479-b7330ba2333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Volume volume-da968131-ac07-4154-8c12-d0d4dea39d01 (da968131-ac07-4154-8c12-d0d4dea39d01): created successfully Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235a7bec-f16d-4721-b479-b7330ba2333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (cf359109-9f24-4e57-a616-5d8f9887a880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-335751bf-0cb9-4d3f-aaf8-29c157ce2c2d tempest-ProjectReaderTests-556780573 None] Created volume successfully. Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-da968131-ac07-4154-8c12-d0d4dea39d01-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "cinder-da968131-ac07-4154-8c12-d0d4dea39d01-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-quobyte-da968131-ac07-4154-8c12-d0d4dea39d01" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-da968131-ac07-4154-8c12-d0d4dea39d01" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[62823df5-0478-418d-ae46-f5cf8f4f2257]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:53 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 Jul 10 08:02:53 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:54 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:54 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01 Jul 10 08:02:54 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:54 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-da968131-ac07-4154-8c12-d0d4dea39d01" returned: 0 in 0.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-da968131-ac07-4154-8c12-d0d4dea39d01" released by "delete_volume" :: held 1.585s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Created reservations ['f055589f-7639-4016-a554-6a817aa3a771', '0b707d0f-9a6d-4003-91de-1e15e98bbd76', '5a79f410-620e-4f26-98a6-5408acc4e303', '8b4a7dcc-9462-4311-a548-51c5d75a710e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:54 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:02:54 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:55 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:02:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Deleted volume successfully. Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5f818a29-5c13-4eed-8dbc-bf347fb6c2ec tempest-ProjectReaderTests-556780573 None] Lock "cinder-da968131-ac07-4154-8c12-d0d4dea39d01-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (173ba5df-4e8b-4009-9eda-08648f064524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174f78bd-be2c-45e3-96ee-f837f332528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174f78bd-be2c-45e3-96ee-f837f332528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557583345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a790a2-66dc-4955-93e9-d6893e695cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:56Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e73cfe1-1a07-4c51-a486-533c08349db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e73cfe1-1a07-4c51-a486-533c08349db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bbf3c5-3488-407a-93f8-7f59e0f9c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bbf3c5-3488-407a-93f8-7f59e0f9c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a790a2-66dc-4955-93e9-d6893e695cb1', 'volume_name': 'volume-b2a790a2-66dc-4955-93e9-d6893e695cb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436110c9-a93f-406a-8250-c345c2a970b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436110c9-a93f-406a-8250-c345c2a970b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b2dd75-e8b0-4525-8e6b-49ec6c995e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Volume b2a790a2-66dc-4955-93e9-d6893e695cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a790a2-66dc-4955-93e9-d6893e695cb1', 'volume_size': 1} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557583345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a790a2-66dc-4955-93e9-d6893e695cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:02:56Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Creating volume b2a790a2-66dc-4955-93e9-d6893e695cb1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:02:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:55 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 1073741824 Jul 10 08:02:55 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:56 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 1073741824" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:56 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 Jul 10 08:02:56 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:57 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b2dd75-e8b0-4525-8e6b-49ec6c995e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a790a2-66dc-4955-93e9-d6893e695cb1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a05200-4bf5-4786-8d28-3cfa789a0efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:02:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Volume volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 (b2a790a2-66dc-4955-93e9-d6893e695cb1): created successfully Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a05200-4bf5-4786-8d28-3cfa789a0efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (173ba5df-4e8b-4009-9eda-08648f064524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:02:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2415dadc-c7be-4a1c-96ea-fffff2a39a42 tempest-ProjectReaderTests-556780573 None] Created volume successfully. Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-b2a790a2-66dc-4955-93e9-d6893e695cb1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "cinder-b2a790a2-66dc-4955-93e9-d6893e695cb1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-quobyte-b2a790a2-66dc-4955-93e9-d6893e695cb1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-b2a790a2-66dc-4955-93e9-d6893e695cb1" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cdd5ef-7926-4dfd-b7a8-895f37efe6a3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:58 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 Jul 10 08:02:58 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[175fc48e-c782-4434-9b35-4185ced014b1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:58 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 Jul 10 08:02:58 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:58 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:58 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1 Jul 10 08:02:58 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:02:59 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895', 'name': 'volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b1d3093-a57a-4fe5-a01f-522eb93bbd5c', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 08:02:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-fb2fabca-ce85-45cf-9e32-d23be3c6c000 req-c3bdda8e-eced-42b5-9b81-357f70080cd7 tempest-TestServerVolumeAttachmentScenario-760845728 None] attachment_update completed successfully. Jul 10 08:02:59 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b2a790a2-66dc-4955-93e9-d6893e695cb1" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-b2a790a2-66dc-4955-93e9-d6893e695cb1" released by "delete_volume" :: held 1.490s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Created reservations ['9b31aff4-a4e4-4e3a-9454-fbc4dc13b9c7', '6f122f19-524a-4180-a562-2efd1d4640bb', 'cd563a0d-ffcc-47ee-ae37-9ebe0dd92d2d', 'e21f6ee9-1303-456c-bb28-556e142afd45'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:02:59 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:02:59 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:00 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Deleted volume successfully. Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdd3e3b1-bc28-4922-946a-33ceba1dcf0c tempest-ProjectReaderTests-556780573 None] Lock "cinder-b2a790a2-66dc-4955-93e9-d6893e695cb1-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (c145fc23-ad57-42be-a206-7261fe454807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8ecd38-fc48-49d2-b17f-3bb26e0a0934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8ecd38-fc48-49d2-b17f-3bb26e0a0934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87657644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e412b162-54c5-4bcf-a9f2-1f52a3055ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:01Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e946ca-7bc2-4e5c-8463-d5157ca0961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e946ca-7bc2-4e5c-8463-d5157ca0961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646c0c6-26aa-435c-a9fe-5c7b7c841850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c646c0c6-26aa-435c-a9fe-5c7b7c841850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e412b162-54c5-4bcf-a9f2-1f52a3055ee4', 'volume_name': 'volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736ff81-81fe-4b79-9fa3-6736b67ffd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736ff81-81fe-4b79-9fa3-6736b67ffd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b8606b-aec3-4c71-a5b5-ad4692ec71cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Volume e412b162-54c5-4bcf-a9f2-1f52a3055ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4', 'volume_size': 1} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87657644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e412b162-54c5-4bcf-a9f2-1f52a3055ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:01Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Creating volume e412b162-54c5-4bcf-a9f2-1f52a3055ee4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:00 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 1073741824 Jul 10 08:03:00 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:01 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 1073741824" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:01 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 Jul 10 08:03:01 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:02 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b8606b-aec3-4c71-a5b5-ad4692ec71cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e9b843-c585-489a-9da5-69305daa2696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Volume volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 (e412b162-54c5-4bcf-a9f2-1f52a3055ee4): created successfully Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e9b843-c585-489a-9da5-69305daa2696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (c145fc23-ad57-42be-a206-7261fe454807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4f24de49-b0e4-46a4-bff0-44c1df549c2a tempest-ProjectReaderTests-556780573 None] Created volume successfully. Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-e412b162-54c5-4bcf-a9f2-1f52a3055ee4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "cinder-e412b162-54c5-4bcf-a9f2-1f52a3055ee4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-quobyte-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea8a22-1721-482c-ad24-c30628578073]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:02 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 Jul 10 08:03:02 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:03 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:03 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4 Jul 10 08:03:03 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:04 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-e412b162-54c5-4bcf-a9f2-1f52a3055ee4" released by "delete_volume" :: held 1.500s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Created reservations ['bdedde87-5ac9-4cd0-b424-5785d8ce2501', '282af1d7-8469-45d5-b4a7-7a63b0b49256', 'e13f0d39-a23e-44f0-867c-df4189ccb18e', '7ed8bb06-2a5a-4378-b1bd-f6487402b944'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:04 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:04 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-683517e2-5ce3-418d-9d97-d471255ef746 req-758e662f-7843-48e6-b365-ca51f5fcfd68 tempest-TestServerVolumeAttachmentScenario-760845728 None] Terminate volume connection completed successfully. Jul 10 08:03:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-683517e2-5ce3-418d-9d97-d471255ef746 req-758e662f-7843-48e6-b365-ca51f5fcfd68 tempest-TestServerVolumeAttachmentScenario-760845728 None] Deleting attachment 7b1d3093-a57a-4fe5-a01f-522eb93bbd5c. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:03:05 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.672s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Deleted volume successfully. Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b402a-6ecc-4a34-bd28-0901e1757c41 tempest-ProjectReaderTests-556780573 None] Lock "cinder-e412b162-54c5-4bcf-a9f2-1f52a3055ee4-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (00169a15-0786-45e5-8601-e28ddf17543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9ee716-db03-4c99-a72d-f91a7811a66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9ee716-db03-4c99-a72d-f91a7811a66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438377335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d74f0-6c58-4081-ada6-17efeb2ffbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:05Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47daf1bd-75fd-4704-9964-015dc3ebf55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47daf1bd-75fd-4704-9964-015dc3ebf55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5093d405-9870-4955-aaeb-0efb4826a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5093d405-9870-4955-aaeb-0efb4826a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364d74f0-6c58-4081-ada6-17efeb2ffbed', 'volume_name': 'volume-364d74f0-6c58-4081-ada6-17efeb2ffbed', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa912e-96df-4bec-a277-32a140d21cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa912e-96df-4bec-a277-32a140d21cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce0a87e-980e-4a85-8574-38f919ba84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Volume 364d74f0-6c58-4081-ada6-17efeb2ffbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364d74f0-6c58-4081-ada6-17efeb2ffbed', 'volume_size': 1} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438377335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364d74f0-6c58-4081-ada6-17efeb2ffbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc79de9e721347fb8624a9b36531f4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:05Z,use_quota=True,user_id='2e249ed810a04a1dae5ea34036105b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Creating volume 364d74f0-6c58-4081-ada6-17efeb2ffbed {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:05 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:05 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed 1073741824 Jul 10 08:03:05 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:06 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed 1073741824" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:06 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed Jul 10 08:03:06 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:06 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce0a87e-980e-4a85-8574-38f919ba84c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364d74f0-6c58-4081-ada6-17efeb2ffbed', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b12c6e-716a-465a-9cb3-efa0552bc75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Volume volume-364d74f0-6c58-4081-ada6-17efeb2ffbed (364d74f0-6c58-4081-ada6-17efeb2ffbed): created successfully Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b12c6e-716a-465a-9cb3-efa0552bc75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Flow 'volume_create_manager' (00169a15-0786-45e5-8601-e28ddf17543c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c41d9f5d-4176-452a-8861-7b714dc352ae tempest-ProjectReaderTests-556780573 None] Created volume successfully. Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-364d74f0-6c58-4081-ada6-17efeb2ffbed-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "cinder-364d74f0-6c58-4081-ada6-17efeb2ffbed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Acquiring lock "cinder-quobyte-364d74f0-6c58-4081-ada6-17efeb2ffbed" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-364d74f0-6c58-4081-ada6-17efeb2ffbed" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d573d9fd-5a59-4caa-9454-beac5fe0c0fb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:07 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed Jul 10 08:03:07 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:08 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:08 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed Jul 10 08:03:08 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f44d3e60-4d03-43d0-b43d-e7ee0b05c9e1 req-891e0165-9b79-46b5-bd28-439991b12b89 tempest-TestServerVolumeAttachmentScenario-760845728 None] Terminate volume connection completed successfully. Jul 10 08:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f44d3e60-4d03-43d0-b43d-e7ee0b05c9e1 req-891e0165-9b79-46b5-bd28-439991b12b89 tempest-TestServerVolumeAttachmentScenario-760845728 None] Deleting attachment 0d04ef0a-81fc-4984-8841-e4daa56061f8. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 08:03:09 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-364d74f0-6c58-4081-ada6-17efeb2ffbed" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "cinder-quobyte-364d74f0-6c58-4081-ada6-17efeb2ffbed" released by "delete_volume" :: held 1.516s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Created reservations ['2fcc5021-6654-43f9-becf-8bd596db7547', 'b082fdd7-027e-44d5-9496-23ff944efae8', '76cd9d0a-0821-43f5-8aa7-961a47c90a32', '86c8ab6e-a0b3-41e4-8a08-8dd2fb0a0c3e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:09 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:09 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:09 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Deleted volume successfully. Jul 10 08:03:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bb2046ba-b447-4e3d-a97e-9cc4c2290840 tempest-ProjectReaderTests-556780573 None] Lock "cinder-364d74f0-6c58-4081-ada6-17efeb2ffbed-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "cinder-b0ae8815-cd76-4036-8b0c-28f12f541bc5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-b0ae8815-cd76-4036-8b0c-28f12f541bc5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "cinder-quobyte-b0ae8815-cd76-4036-8b0c-28f12f541bc5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-quobyte-b0ae8815-cd76-4036-8b0c-28f12f541bc5" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[643caf1f-e654-4595-924b-e237d5d09550]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:19 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 Jul 10 08:03:19 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:19 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:19 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5 Jul 10 08:03:19 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:20 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b0ae8815-cd76-4036-8b0c-28f12f541bc5" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-quobyte-b0ae8815-cd76-4036-8b0c-28f12f541bc5" released by "delete_volume" :: held 1.434s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Created reservations ['1a713cb9-2519-43bc-a050-fdc13c5e3e28', '40407c4b-25b1-4a2e-976e-d2257d1afb5e', 'fd9a87f0-3ab8-4a6d-9b79-daeddddbc5d2', 'bed91663-34f2-48fa-a491-ad58284a7896'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:20 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:20 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "cinder-658feffa-f7b3-49fa-b3e7-766fe8024e9c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-658feffa-f7b3-49fa-b3e7-766fe8024e9c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:21 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Deleted volume successfully. Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "cinder-quobyte-658feffa-f7b3-49fa-b3e7-766fe8024e9c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4fc15ca1-d2d6-4562-9587-6478b77e9d69 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-b0ae8815-cd76-4036-8b0c-28f12f541bc5-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-quobyte-658feffa-f7b3-49fa-b3e7-766fe8024e9c" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd39b3e-45a2-474f-a9c5-92e22d9463a3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:21 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c Jul 10 08:03:21 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:21 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:22 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c Jul 10 08:03:22 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:22 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-658feffa-f7b3-49fa-b3e7-766fe8024e9c" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-quobyte-658feffa-f7b3-49fa-b3e7-766fe8024e9c" released by "delete_volume" :: held 1.444s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Created reservations ['4578ff1b-948f-4e03-8eac-feb8b8b22e53', 'be99515b-988f-4f56-b85a-bb161ec01fd1', '021036ea-9a44-4bc2-a917-cf0980149dc1', '27bbed48-a802-40bb-a745-87c1c2aeff6a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:22 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:22 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:23 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:23 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Deleted volume successfully. Jul 10 08:03:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07c11ef2-844f-4643-bcee-87a73653f6f3 tempest-TestServerVolumeAttachmentScenario-760845728 None] Lock "cinder-658feffa-f7b3-49fa-b3e7-766fe8024e9c-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (be64e624-b57a-425a-8b98-950e5049c411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c8d6f9-d113-4753-821c-bd89bc7b5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c8d6f9-d113-4753-821c-bd89bc7b5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-553893468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1adfbf-6856-49a8-ad2b-9482d63cb382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:32Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db63d33-4869-400f-8984-c88a9f33bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db63d33-4869-400f-8984-c88a9f33bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc31c45-67eb-45b6-b52e-5a5c5d5ec2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc31c45-67eb-45b6-b52e-5a5c5d5ec2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1adfbf-6856-49a8-ad2b-9482d63cb382', 'volume_name': 'volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eccd36-4a64-4571-8874-9d6a1f863a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eccd36-4a64-4571-8874-9d6a1f863a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33aadb8-d11e-4ac8-ae82-e7cd7f504404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume 0b1adfbf-6856-49a8-ad2b-9482d63cb382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382', 'volume_size': 1} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-553893468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1adfbf-6856-49a8-ad2b-9482d63cb382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:32Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume 0b1adfbf-6856-49a8-ad2b-9482d63cb382 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:32 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:32 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 1073741824 Jul 10 08:03:32 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:33 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 1073741824" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:33 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 Jul 10 08:03:33 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:34 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33aadb8-d11e-4ac8-ae82-e7cd7f504404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1baac-254c-4072-ba53-56696cfc06bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 (0b1adfbf-6856-49a8-ad2b-9482d63cb382): created successfully Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1baac-254c-4072-ba53-56696cfc06bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (be64e624-b57a-425a-8b98-950e5049c411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5fc5ac19-beef-43f7-94a5-7a599f903c5d tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (9223e4d8-3c26-4178-bc0f-274182d60602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea574afc-0205-4715-b97a-48698f052009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea574afc-0205-4715-b97a-48698f052009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833040414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9be2807-5452-4059-b4af-a9c06a1e7585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:35Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f27df3d-13c4-45c6-bcf6-1e8a2d22fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f27df3d-13c4-45c6-bcf6-1e8a2d22fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690cb476-71bf-4751-8405-42e43318b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690cb476-71bf-4751-8405-42e43318b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9be2807-5452-4059-b4af-a9c06a1e7585', 'volume_name': 'volume-e9be2807-5452-4059-b4af-a9c06a1e7585', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5563d969-4ef9-42dd-b040-402330009074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5563d969-4ef9-42dd-b040-402330009074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b9d87c-9ef7-4af5-b188-b04cce44c79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume e9be2807-5452-4059-b4af-a9c06a1e7585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9be2807-5452-4059-b4af-a9c06a1e7585', 'volume_size': 1} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833040414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9be2807-5452-4059-b4af-a9c06a1e7585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:35Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume e9be2807-5452-4059-b4af-a9c06a1e7585 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:35 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 1073741824 Jul 10 08:03:35 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (f50e6b3d-3388-4f15-976b-1b6da9bf7480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60baf9f6-45cc-4f4f-9360-c99a14d75f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60baf9f6-45cc-4f4f-9360-c99a14d75f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204102238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512907db-de33-4e6a-948f-64070fd6dead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:35Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90469cd-2794-4241-a408-4acce3ec567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90469cd-2794-4241-a408-4acce3ec567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fdaa6a-a212-4e64-b904-66455aac0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fdaa6a-a212-4e64-b904-66455aac0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512907db-de33-4e6a-948f-64070fd6dead', 'volume_name': 'volume-512907db-de33-4e6a-948f-64070fd6dead', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661faa73-a8cb-4952-adac-7ee4c2d44f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661faa73-a8cb-4952-adac-7ee4c2d44f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d8d23-ea33-40ae-b5a5-abe2e685b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume 512907db-de33-4e6a-948f-64070fd6dead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512907db-de33-4e6a-948f-64070fd6dead', 'volume_size': 1} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (8c104a06-502c-4dbe-a5bf-f8f05f49017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ea24b3-d9e9-4f78-9c35-d25f21ca2d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ea24b3-d9e9-4f78-9c35-d25f21ca2d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021960249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a9e414-23f1-4f0f-b19c-9bcecc9371ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53563144-165d-47d6-9eb0-572b8db03ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53563144-165d-47d6-9eb0-572b8db03ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c80370-cbf4-4ceb-9064-7eb6faaf15c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c80370-cbf4-4ceb-9064-7eb6faaf15c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a9e414-23f1-4f0f-b19c-9bcecc9371ad', 'volume_name': 'volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5161c4c-cc0e-48a5-9a3e-5c4115806db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5161c4c-cc0e-48a5-9a3e-5c4115806db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d263b852-dbce-4893-a6b6-b3d47ffec888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume 71a9e414-23f1-4f0f-b19c-9bcecc9371ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad', 'volume_size': 1} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:35 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 1073741824" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:36 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 Jul 10 08:03:36 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (d5c38b03-9a12-4f51-ae51-dc0a9eb9891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb33160-e026-44d7-a769-7b71f5cf995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb33160-e026-44d7-a769-7b71f5cf995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636014812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab8366-b82b-4277-a31b-fd6f76bb88df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6571c746-8e60-4c20-93a8-2028f108200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6571c746-8e60-4c20-93a8-2028f108200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539925ab-099d-4df9-9cb1-5460d5ece1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539925ab-099d-4df9-9cb1-5460d5ece1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ab8366-b82b-4277-a31b-fd6f76bb88df', 'volume_name': 'volume-72ab8366-b82b-4277-a31b-fd6f76bb88df', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2e52e-c0a9-41ec-8151-12ea6f11fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2e52e-c0a9-41ec-8151-12ea6f11fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42eb0fc-74c7-4371-8c12-6e1b404a928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume 72ab8366-b82b-4277-a31b-fd6f76bb88df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ab8366-b82b-4277-a31b-fd6f76bb88df', 'volume_size': 1} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (4c2cd30f-ddbb-45f3-be87-a4cd6fc90374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793a9e7-9d18-4c33-85e2-e8ad1c632e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793a9e7-9d18-4c33-85e2-e8ad1c632e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108000892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2af85ac-20d7-4074-8a4a-04af22a4f206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f6d144-d1e6-4579-bbac-c270d9fa01e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f6d144-d1e6-4579-bbac-c270d9fa01e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac0317-1877-4638-a714-7d05b0fea979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac0317-1877-4638-a714-7d05b0fea979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2af85ac-20d7-4074-8a4a-04af22a4f206', 'volume_name': 'volume-c2af85ac-20d7-4074-8a4a-04af22a4f206', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76011cfd-829f-4167-a3d1-63577bcd02d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76011cfd-829f-4167-a3d1-63577bcd02d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1945f14f-b35c-41b0-80c5-45f1a6c27244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume c2af85ac-20d7-4074-8a4a-04af22a4f206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2af85ac-20d7-4074-8a4a-04af22a4f206', 'volume_size': 1} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:36 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:36 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:36 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204102238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512907db-de33-4e6a-948f-64070fd6dead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:35Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume 512907db-de33-4e6a-948f-64070fd6dead {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b9d87c-9ef7-4af5-b188-b04cce44c79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9be2807-5452-4059-b4af-a9c06a1e7585', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead 1073741824 Jul 10 08:03:36 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79e7c6-0ce0-4f13-a46b-48e86c28ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-e9be2807-5452-4059-b4af-a9c06a1e7585 (e9be2807-5452-4059-b4af-a9c06a1e7585): created successfully Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79e7c6-0ce0-4f13-a46b-48e86c28ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (9223e4d8-3c26-4178-bc0f-274182d60602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-143bccf0-c33e-44d4-a53e-c0d90adb2e3c tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:37 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:03:37 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead 1073741824" returned: 0 in 0.883s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:37 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead Jul 10 08:03:37 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:38 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021960249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a9e414-23f1-4f0f-b19c-9bcecc9371ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume 71a9e414-23f1-4f0f-b19c-9bcecc9371ad {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:38 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d8d23-ea33-40ae-b5a5-abe2e685b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512907db-de33-4e6a-948f-64070fd6dead', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:38 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad 1073741824 Jul 10 08:03:38 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2956b30-cf5b-49b9-bfdc-cacc8b4c0a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-512907db-de33-4e6a-948f-64070fd6dead (512907db-de33-4e6a-948f-64070fd6dead): created successfully Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2956b30-cf5b-49b9-bfdc-cacc8b4c0a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (f50e6b3d-3388-4f15-976b-1b6da9bf7480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:38 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=58,cinder:UPDATE=78,cinder:DELETE=6,cinder:INSERT=12 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:03:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-baa8673c-07b7-4119-a850-4d8e84e63f9b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:39 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad 1073741824" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:39 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad Jul 10 08:03:39 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:39 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" returned: 0 in 0.659s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.655s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636014812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab8366-b82b-4277-a31b-fd6f76bb88df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume 72ab8366-b82b-4277-a31b-fd6f76bb88df {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:39 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df 1073741824 Jul 10 08:03:39 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d263b852-dbce-4893-a6b6-b3d47ffec888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ec863-8637-44a2-b348-5224ca7a5eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad (71a9e414-23f1-4f0f-b19c-9bcecc9371ad): created successfully Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8ec863-8637-44a2-b348-5224ca7a5eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (8c104a06-502c-4dbe-a5bf-f8f05f49017f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b54aaef3-b9e2-4636-9c3a-d8c6313a74c7 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:40 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df 1073741824" returned: 0 in 0.813s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:40 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df Jul 10 08:03:40 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:41 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.838s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108000892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2af85ac-20d7-4074-8a4a-04af22a4f206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46c441279f34d2fb76cb7b8be7c148a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:36Z,use_quota=True,user_id='9028f9149b3a4f3c80128e407467dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Creating volume c2af85ac-20d7-4074-8a4a-04af22a4f206 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:41 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42eb0fc-74c7-4371-8c12-6e1b404a928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ab8366-b82b-4277-a31b-fd6f76bb88df', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:41 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 1073741824 Jul 10 08:03:41 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354867e7-948e-4e6e-95d6-deee40c37c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-72ab8366-b82b-4277-a31b-fd6f76bb88df (72ab8366-b82b-4277-a31b-fd6f76bb88df): created successfully Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354867e7-948e-4e6e-95d6-deee40c37c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (d5c38b03-9a12-4f51-ae51-dc0a9eb9891e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0537d08-8180-4cb3-b272-815d21040296 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:42 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 1073741824" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:42 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 Jul 10 08:03:42 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:42 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1945f14f-b35c-41b0-80c5-45f1a6c27244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2af85ac-20d7-4074-8a4a-04af22a4f206', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2066eb63-acef-4569-9f0d-64a724f38fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Volume volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 (c2af85ac-20d7-4074-8a4a-04af22a4f206): created successfully Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2066eb63-acef-4569-9f0d-64a724f38fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Flow 'volume_create_manager' (4c2cd30f-ddbb-45f3-be87-a4cd6fc90374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b33d6c01-e0ae-4890-a0a2-cd3771c2e1bd tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created volume successfully. Jul 10 08:03:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-c2af85ac-20d7-4074-8a4a-04af22a4f206-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-c2af85ac-20d7-4074-8a4a-04af22a4f206-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-c2af85ac-20d7-4074-8a4a-04af22a4f206" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-c2af85ac-20d7-4074-8a4a-04af22a4f206" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba6dcd-faf0-4e02-b3ce-b2008f5a2bb8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:43 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 Jul 10 08:03:43 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:43 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:43 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206 Jul 10 08:03:43 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:44 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2af85ac-20d7-4074-8a4a-04af22a4f206" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-c2af85ac-20d7-4074-8a4a-04af22a4f206" released by "delete_volume" :: held 1.442s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['b29335be-f416-4322-8192-f86812e4e6da', '860ec32f-6df4-4e63-a73d-1cd9863daba5', 'b7e30317-c72a-425b-bb96-a07f85da6d6d', '53ac2792-d11d-4d5a-895d-805f11cf6b0f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:44 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:44 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-72ab8366-b82b-4277-a31b-fd6f76bb88df-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-72ab8366-b82b-4277-a31b-fd6f76bb88df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:45 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-72ab8366-b82b-4277-a31b-fd6f76bb88df" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-72ab8366-b82b-4277-a31b-fd6f76bb88df" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93d1b0-1792-4135-b9df-66785bcbae72]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbbf5e20-3865-4e31-b745-6b38ea35c5a2 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-c2af85ac-20d7-4074-8a4a-04af22a4f206-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:45 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df Jul 10 08:03:45 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:46 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:46 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df Jul 10 08:03:46 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:46 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-72ab8366-b82b-4277-a31b-fd6f76bb88df" returned: 0 in 0.638s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-72ab8366-b82b-4277-a31b-fd6f76bb88df" released by "delete_volume" :: held 1.413s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['60715390-6c0e-4e58-a0d2-c3cf4333d29a', '0b5f23b0-ab2f-4806-b8a0-155729d74ae5', '7c218ab6-987f-4e85-afb1-0e38298ef41a', '3c3489c3-a1ef-44e6-8559-eea58da41ee0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:46 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:46 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-71a9e414-23f1-4f0f-b19c-9bcecc9371ad-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:47 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-71a9e414-23f1-4f0f-b19c-9bcecc9371ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a786c440-24ea-4d13-9129-4aefb7f694d8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-72ab8366-b82b-4277-a31b-fd6f76bb88df-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308834a-e3a4-46a1-be3d-ccfa1081fb2f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:47 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad Jul 10 08:03:47 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:48 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:48 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad Jul 10 08:03:48 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:48 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-71a9e414-23f1-4f0f-b19c-9bcecc9371ad" released by "delete_volume" :: held 1.421s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:48 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=78,cinder:UPDATE=91,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['f08f5611-f05c-43f3-b1de-c376add99687', '84aa975e-1ec2-4b59-9861-d0ffc0cc611a', '9d9d4947-7fc6-4fc3-a8ff-db8a4c10425d', 'c5b3489f-8362-4788-b3ce-e4021a674756'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:49 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:49 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-512907db-de33-4e6a-948f-64070fd6dead-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:49 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.631s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-512907db-de33-4e6a-948f-64070fd6dead-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a17f932-022e-4f8b-9f4c-f230b71786e8 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-71a9e414-23f1-4f0f-b19c-9bcecc9371ad-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-512907db-de33-4e6a-948f-64070fd6dead" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-512907db-de33-4e6a-948f-64070fd6dead" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[37888f11-6a92-49a0-a31d-bc480f80ae1d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:49 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead Jul 10 08:03:49 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:50 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:50 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead Jul 10 08:03:50 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-512907db-de33-4e6a-948f-64070fd6dead" returned: 0 in 0.630s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-512907db-de33-4e6a-948f-64070fd6dead" released by "delete_volume" :: held 1.412s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['5f4cd01b-2a79-4d58-a77b-3ccddc9abd84', '03b202a4-8336-4a84-9f35-90c851450c43', '08a83398-62a8-42dc-ac5b-6cc40dfb4d9b', '815fa4da-1088-45f0-9577-3a99e71f17cf'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:51 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:51 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-e9be2807-5452-4059-b4af-a9c06a1e7585-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:51 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-e9be2807-5452-4059-b4af-a9c06a1e7585-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d65b11d9-a569-453a-90f3-0e9133ffdf67 tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-512907db-de33-4e6a-948f-64070fd6dead-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-e9be2807-5452-4059-b4af-a9c06a1e7585" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-e9be2807-5452-4059-b4af-a9c06a1e7585" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128bcef-8f71-414b-83d0-b0e0c0103f8b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:52 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 Jul 10 08:03:52 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:52 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:52 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585 Jul 10 08:03:52 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:53 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e9be2807-5452-4059-b4af-a9c06a1e7585" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-e9be2807-5452-4059-b4af-a9c06a1e7585" released by "delete_volume" :: held 1.445s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['97ac73ca-32e5-43ca-b617-6773b4473b33', '67452920-5273-4455-98bb-afc3f189ce3e', 'e37ce10c-39f8-48c6-a4ee-dc11993f4038', 'cdb2f831-1dd5-4897-ac67-3a4aa5a6468d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:53 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:53 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-0b1adfbf-6856-49a8-ad2b-9482d63cb382-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-0b1adfbf-6856-49a8-ad2b-9482d63cb382-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "cinder-quobyte-0b1adfbf-6856-49a8-ad2b-9482d63cb382" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:03:54 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-0b1adfbf-6856-49a8-ad2b-9482d63cb382" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:03:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df669f2-0af5-4c63-94a8-17a055cc3275]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-72185afb-9669-41d0-9dda-c74547fd085b tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-e9be2807-5452-4059-b4af-a9c06a1e7585-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:54 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 Jul 10 08:03:54 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:54 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:55 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382 Jul 10 08:03:55 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:55 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-0b1adfbf-6856-49a8-ad2b-9482d63cb382" returned: 0 in 0.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-quobyte-0b1adfbf-6856-49a8-ad2b-9482d63cb382" released by "delete_volume" :: held 1.468s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Created reservations ['465bc695-80db-4888-b4bd-972cfd4bd59a', '317e824c-cd54-411d-aa00-a951eeeaa941', '1e2c2352-2c62-473e-ad4a-a5a2ab3577e5', '9c1a404d-7032-4240-ab4e-aa9a86a48c23'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:55 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:03:55 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:03:56 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 10 08:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:03:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:03:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Deleted volume successfully. Jul 10 08:03:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5a72ebd-56f8-4b87-b5ca-8b5fd06b081a tempest-CreateVolumesFromSourceVolumeTest-539001348 None] Lock "cinder-0b1adfbf-6856-49a8-ad2b-9482d63cb382-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Flow 'volume_create_manager' (69dfbc2c-00d8-4843-b0df-9abb13c0e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f44736-b99a-4d86-9316-61979d9f8ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f44736-b99a-4d86-9316-61979d9f8ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277437597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1015eacd-1d94-40ba-860b-c0f89bedfabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9931314223f74d7cbbfc806091f5c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:59Z,use_quota=True,user_id='7807d545a98f4e9e92ddb9a98788a818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151ccf7e-5a40-42e7-af83-abe72a21c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151ccf7e-5a40-42e7-af83-abe72a21c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f85a38-986a-4e23-8011-db7031c0bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f85a38-986a-4e23-8011-db7031c0bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1015eacd-1d94-40ba-860b-c0f89bedfabb', 'volume_name': 'volume-1015eacd-1d94-40ba-860b-c0f89bedfabb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac3214-0c13-4aed-b047-74cc6d132f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ac3214-0c13-4aed-b047-74cc6d132f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f9d07d-56e6-4eba-875f-5735fc8505a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:03:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Volume 1015eacd-1d94-40ba-860b-c0f89bedfabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1015eacd-1d94-40ba-860b-c0f89bedfabb', 'volume_size': 1} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277437597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1015eacd-1d94-40ba-860b-c0f89bedfabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9931314223f74d7cbbfc806091f5c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:03:59Z,use_quota=True,user_id='7807d545a98f4e9e92ddb9a98788a818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Creating volume 1015eacd-1d94-40ba-860b-c0f89bedfabb {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:03:59 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:03:59 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb 1073741824 Jul 10 08:03:59 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:00 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb 1073741824" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:00 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb Jul 10 08:04:00 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:01 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb" returned: 0 in 0.621s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f9d07d-56e6-4eba-875f-5735fc8505a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1015eacd-1d94-40ba-860b-c0f89bedfabb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769c1bad-737a-4af1-9836-929ee3354451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Volume volume-1015eacd-1d94-40ba-860b-c0f89bedfabb (1015eacd-1d94-40ba-860b-c0f89bedfabb): created successfully Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769c1bad-737a-4af1-9836-929ee3354451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Flow 'volume_create_manager' (69dfbc2c-00d8-4843-b0df-9abb13c0e573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a0c6d9c-86a5-451e-8000-45c25197347f tempest-ProjectReaderTests-170660160 None] Created volume successfully. Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Acquiring lock "cinder-1015eacd-1d94-40ba-860b-c0f89bedfabb-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "cinder-1015eacd-1d94-40ba-860b-c0f89bedfabb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Acquiring lock "cinder-quobyte-1015eacd-1d94-40ba-860b-c0f89bedfabb" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "cinder-quobyte-1015eacd-1d94-40ba-860b-c0f89bedfabb" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a9d36-6c29-443c-b8df-7433ac3566cd]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:01 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb Jul 10 08:04:01 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:02 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:02 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb Jul 10 08:04:02 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:03 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1015eacd-1d94-40ba-860b-c0f89bedfabb" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "cinder-quobyte-1015eacd-1d94-40ba-860b-c0f89bedfabb" released by "delete_volume" :: held 1.392s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Created reservations ['a644b6aa-0190-406b-aa88-81841b5aa2e9', '3d9abd06-77bb-47bc-bafe-7a0714548e62', '3027e097-bbbc-4456-990f-487d4e14126c', 'cea7d8c3-0d7b-4ce0-8a3b-fa4a0f8cabdb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:03 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:03 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:03 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Deleted volume successfully. Jul 10 08:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b17e9cc-dd1f-4893-bd4d-03816541756b tempest-ProjectReaderTests-170660160 None] Lock "cinder-1015eacd-1d94-40ba-860b-c0f89bedfabb-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Flow 'volume_create_manager' (829599cc-e8f7-426a-84bb-2b5c2155dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052a223c-f103-46df-8b2a-36416681816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052a223c-f103-46df-8b2a-36416681816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494946787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578ac98-9230-4f3b-8f17-67ad4d942fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9931314223f74d7cbbfc806091f5c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:04Z,use_quota=True,user_id='7807d545a98f4e9e92ddb9a98788a818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae722bc-9cfe-4cd6-a09f-97a7c7197e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae722bc-9cfe-4cd6-a09f-97a7c7197e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6a9f36-1aae-47d7-9056-71cf297e397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6a9f36-1aae-47d7-9056-71cf297e397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1578ac98-9230-4f3b-8f17-67ad4d942fe3', 'volume_name': 'volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6b3d15-0d5c-4e72-8476-e7d67e50bbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6b3d15-0d5c-4e72-8476-e7d67e50bbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402f1001-c75b-463a-a2f0-4b64e96f72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Volume 1578ac98-9230-4f3b-8f17-67ad4d942fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3', 'volume_size': 1} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494946787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578ac98-9230-4f3b-8f17-67ad4d942fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9931314223f74d7cbbfc806091f5c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:04Z,use_quota=True,user_id='7807d545a98f4e9e92ddb9a98788a818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Creating volume 1578ac98-9230-4f3b-8f17-67ad4d942fe3 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:04 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 1073741824 Jul 10 08:04:04 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:05 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 1073741824" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:05 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 Jul 10 08:04:05 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:05 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402f1001-c75b-463a-a2f0-4b64e96f72c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce143b-9ebc-44c2-a027-fe121cba79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Volume volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 (1578ac98-9230-4f3b-8f17-67ad4d942fe3): created successfully Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce143b-9ebc-44c2-a027-fe121cba79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Flow 'volume_create_manager' (829599cc-e8f7-426a-84bb-2b5c2155dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-23324491-5d7f-4b3f-822c-1d531d735a62 tempest-ProjectReaderTests-170660160 None] Created volume successfully. Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Acquiring lock "cinder-1578ac98-9230-4f3b-8f17-67ad4d942fe3-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "cinder-1578ac98-9230-4f3b-8f17-67ad4d942fe3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Acquiring lock "cinder-quobyte-1578ac98-9230-4f3b-8f17-67ad4d942fe3" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "cinder-quobyte-1578ac98-9230-4f3b-8f17-67ad4d942fe3" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c036b-9b1a-4078-b5db-4f1f56e37ab8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:06 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 Jul 10 08:04:06 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:07 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:07 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3 Jul 10 08:04:07 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:07 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1578ac98-9230-4f3b-8f17-67ad4d942fe3" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "cinder-quobyte-1578ac98-9230-4f3b-8f17-67ad4d942fe3" released by "delete_volume" :: held 1.463s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Created reservations ['25528c73-a6a7-494b-b726-2aa173bd75cd', '8e73c35f-0685-4902-be54-bdf4f662434c', 'b49c58f4-3a0d-4a0a-bb99-c67fd6ec1603', '287d48d0-2412-4584-8185-a7317e653c13'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:08 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:08 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:08 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Deleted volume successfully. Jul 10 08:04:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a56b58be-8d17-4d38-8d3b-ecbb9921c246 tempest-ProjectReaderTests-170660160 None] Lock "cinder-1578ac98-9230-4f3b-8f17-67ad4d942fe3-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=54,cinder:SELECT=30,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:04:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=80,cinder:SELECT=49,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (1d3125ac-e564-4ab8-8215-b070236e6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e96c7f-4a89-48d7-b762-8d16b2a761fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e96c7f-4a89-48d7-b762-8d16b2a761fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389394826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf2bc77-f1ab-40fe-ae81-fef4ada57549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:20Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cde9b1d-bdd4-4c2e-8c82-abc5a2cb46e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cde9b1d-bdd4-4c2e-8c82-abc5a2cb46e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0057c880-1236-4c76-a228-439c80750950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0057c880-1236-4c76-a228-439c80750950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf2bc77-f1ab-40fe-ae81-fef4ada57549', 'volume_name': 'volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883059e-e889-4c68-a4d4-a2a325882860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883059e-e889-4c68-a4d4-a2a325882860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e25c7-2c7b-405d-951b-697f3a4e310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Volume 5cf2bc77-f1ab-40fe-ae81-fef4ada57549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549', 'volume_size': 1} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389394826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf2bc77-f1ab-40fe-ae81-fef4ada57549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:20Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Creating volume 5cf2bc77-f1ab-40fe-ae81-fef4ada57549 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:20 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 1073741824 Jul 10 08:04:20 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Flow 'volume_create_manager' (fcca98a5-96d6-4c57-aff0-489e14bbb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7540dd68-eebe-489c-a6e3-d7d564891eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7540dd68-eebe-489c-a6e3-d7d564891eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d592a6-84db-47d9-90f4-c5862152bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05e0d118a141078633c6e750f6431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:21Z,use_quota=True,user_id='a046f15e10244b32821bca660ae41379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8dc95b-2250-414e-94b4-43814307b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8dc95b-2250-414e-94b4-43814307b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41dee8c-6810-46dc-966b-f627795ba6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41dee8c-6810-46dc-966b-f627795ba6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d592a6-84db-47d9-90f4-c5862152bd38', 'volume_name': 'volume-e5d592a6-84db-47d9-90f4-c5862152bd38', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349a94d-a970-47ce-9b50-4db7d5c3487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2349a94d-a970-47ce-9b50-4db7d5c3487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcfcca9-f361-470d-89c9-2ab14136f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Volume e5d592a6-84db-47d9-90f4-c5862152bd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d592a6-84db-47d9-90f4-c5862152bd38', 'volume_size': 1} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (d1f1c5e4-0eda-4255-a273-c57a5a579f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7e052b-a3e8-4dc7-b196-2d471c629263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7e052b-a3e8-4dc7-b196-2d471c629263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005565659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad06c1b-9f78-45e2-b431-82ecb4db8676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:21Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa8624-4401-41e9-84a0-0219290d71c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa8624-4401-41e9-84a0-0219290d71c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfd1e62-cefe-4705-8ed3-04cafbc58216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfd1e62-cefe-4705-8ed3-04cafbc58216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad06c1b-9f78-45e2-b431-82ecb4db8676', 'volume_name': 'volume-aad06c1b-9f78-45e2-b431-82ecb4db8676', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d23ccd-5e2c-4f52-8589-86df29618397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d23ccd-5e2c-4f52-8589-86df29618397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85de7850-497c-4042-82bc-6a3d3fcbb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Volume aad06c1b-9f78-45e2-b431-82ecb4db8676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad06c1b-9f78-45e2-b431-82ecb4db8676', 'volume_size': 1} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (512a89af-90f5-4bd0-b81f-3ce4ed0bd625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9792bec-7403-4f96-b302-eae2673c3166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9792bec-7403-4f96-b302-eae2673c3166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507398027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb9ad88-dfb3-49de-9d3c-031347c927a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:22Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88daaff-ce00-40c2-96e5-4cf5cbab0d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88daaff-ce00-40c2-96e5-4cf5cbab0d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f18fa7-b309-4bb7-a148-7f2dce013591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f18fa7-b309-4bb7-a148-7f2dce013591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb9ad88-dfb3-49de-9d3c-031347c927a0', 'volume_name': 'volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec288dad-bfaf-4508-8fd6-b49942a7f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec288dad-bfaf-4508-8fd6-b49942a7f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192b4e3-20bc-4f90-8414-992394f95c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Volume cfb9ad88-dfb3-49de-9d3c-031347c927a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0', 'volume_size': 1} Jul 10 08:04:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:22 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 1073741824" returned: 0 in 1.395s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:22 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 Jul 10 08:04:22 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (0db1f876-6131-4ef9-9db9-db50ab4d52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8be4fc-66df-48f7-9a42-4d1a3ca8cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8be4fc-66df-48f7-9a42-4d1a3ca8cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692991419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f8175-87e4-4401-8711-0df19a9508e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:22Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dad6a1-fbaf-49da-8be7-f59d79a8ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5dad6a1-fbaf-49da-8be7-f59d79a8ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0816038-0eff-4f1b-b37f-a4293850b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0816038-0eff-4f1b-b37f-a4293850b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08f8175-87e4-4401-8711-0df19a9508e3', 'volume_name': 'volume-d08f8175-87e4-4401-8711-0df19a9508e3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf794f9-07a6-470b-8205-0a6c0ee10a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf794f9-07a6-470b-8205-0a6c0ee10a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae17755-6feb-466d-83c9-d18875bc1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Volume d08f8175-87e4-4401-8711-0df19a9508e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08f8175-87e4-4401-8711-0df19a9508e3', 'volume_size': 1} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (e56d9b58-ee46-4877-b491-c10a7c1c8729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4376e42c-98f4-443b-ad7d-57d79f5666d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4376e42c-98f4-443b-ad7d-57d79f5666d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392580451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398b66eb-017e-44ef-8625-1cd202bd8f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:23Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f669dc4e-af08-4bed-922c-53e1f91ae3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f669dc4e-af08-4bed-922c-53e1f91ae3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135215b7-7a9a-4394-9f44-a7cafd7389c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135215b7-7a9a-4394-9f44-a7cafd7389c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398b66eb-017e-44ef-8625-1cd202bd8f6e', 'volume_name': 'volume-398b66eb-017e-44ef-8625-1cd202bd8f6e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c001682-2652-4f40-b1d7-3330baf2b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c001682-2652-4f40-b1d7-3330baf2b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1a0234-5456-497d-a21b-478a1f4abd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Volume 398b66eb-017e-44ef-8625-1cd202bd8f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398b66eb-017e-44ef-8625-1cd202bd8f6e', 'volume_size': 1} Jul 10 08:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:23 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" returned: 0 in 0.849s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d592a6-84db-47d9-90f4-c5862152bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05e0d118a141078633c6e750f6431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:21Z,use_quota=True,user_id='a046f15e10244b32821bca660ae41379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Creating volume e5d592a6-84db-47d9-90f4-c5862152bd38 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:23 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:23 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 1073741824 Jul 10 08:04:23 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e25c7-2c7b-405d-951b-697f3a4e310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69ec0f-0b97-4d11-99f7-2d20911e451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Volume volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 (5cf2bc77-f1ab-40fe-ae81-fef4ada57549): created successfully Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69ec0f-0b97-4d11-99f7-2d20911e451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (1d3125ac-e564-4ab8-8215-b070236e6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-26313780-5cb8-4d24-9f0a-9ed42a3ffe69 tempest-CreateVolumesFromImageTest-1680497915 None] Created volume successfully. Jul 10 08:04:23 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Flow 'volume_create_manager' (4999d8a7-23bb-48b6-95fc-a50c652b851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de691b3-7cd8-4f45-9116-d9d7b24c56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 1073741824" returned: 0 in 0.969s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de691b3-7cd8-4f45-9116-d9d7b24c56b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f9bade-19d7-4b53-a6e6-903bb16c5600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c5897dd1654c29b93ae4b9f018e71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:24Z,use_quota=True,user_id='2bee3c807dcd4e13b2dc7c4d568ec948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b733a43-54fb-4615-bc27-09081b3587b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b733a43-54fb-4615-bc27-09081b3587b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011b3fe2-61ef-460c-8e0f-52fdda8559ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:24 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 Jul 10 08:04:24 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011b3fe2-61ef-460c-8e0f-52fdda8559ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2f9bade-19d7-4b53-a6e6-903bb16c5600', 'volume_name': 'volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600', 'volume_size': 1, 'image_id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2eed32701149e045e4b74cc14b17cbfc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c5897dd1654c29b93ae4b9f018e71d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac9d30ecb331ef1191c1e77238df9263aa1bbad41402cc6355ee35224c67664f8590ac144e4f4ed610a3f54f34edc143fba394ec97efe1a64d1eee7187f80f19', 'id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758870ff-0115-4c83-91e3-fb2206dc2728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758870ff-0115-4c83-91e3-fb2206dc2728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b82895-5b7e-42ca-a5f4-7c04b29ad273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Volume c2f9bade-19d7-4b53-a6e6-903bb16c5600: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600', 'volume_size': 1, 'image_id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2eed32701149e045e4b74cc14b17cbfc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c5897dd1654c29b93ae4b9f018e71d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac9d30ecb331ef1191c1e77238df9263aa1bbad41402cc6355ee35224c67664f8590ac144e4f4ed610a3f54f34edc143fba394ec97efe1a64d1eee7187f80f19', 'id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08/file', 'properties': {}}, 'image_service': } Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Trying to clone c2f9bade-19d7-4b53-a6e6-903bb16c5600 from image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 08:04:24 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Image download 0.00 MB at 0.00 MB/s Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffb6c5-cd58-4cf1-94ac-8b8175401742]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:24 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:24 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:24 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38" returned: 0 in 0.729s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.529s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005565659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad06c1b-9f78-45e2-b431-82ecb4db8676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:21Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Creating volume aad06c1b-9f78-45e2-b431-82ecb4db8676 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:24 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:24 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 1073741824 Jul 10 08:04:24 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcfcca9-f361-470d-89c9-2ab14136f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d592a6-84db-47d9-90f4-c5862152bd38', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e0340c-dca6-44ad-8a53-7db69bb94bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Volume volume-e5d592a6-84db-47d9-90f4-c5862152bd38 (e5d592a6-84db-47d9-90f4-c5862152bd38): created successfully Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e0340c-dca6-44ad-8a53-7db69bb94bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Flow 'volume_create_manager' (fcca98a5-96d6-4c57-aff0-489e14bbb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5b4b97ad-08d4-449a-abf9-7dd79d03988c tempest-CinderUnicodeTest-410322668 None] Created volume successfully. Jul 10 08:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Flow 'volume_create_manager' (2c82863f-c3ce-416d-8603-611df709e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1562f9e1-a0cf-4d73-8afd-a75cfb2a3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1562f9e1-a0cf-4d73-8afd-a75cfb2a3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db999c2f-4e9f-4d36-b327-01f6434df728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c505da6e374017842321eeccedcd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:25Z,use_quota=True,user_id='d68e067dd8f846bfb5a8ff5110253f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76875ab4-f702-4dfc-8b78-973d0d602e85),volume_type_id=76875ab4-f702-4dfc-8b78-973d0d602e85)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b0e763-b5c3-429a-a5a9-47e4c500c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b0e763-b5c3-429a-a5a9-47e4c500c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46642ed-e4c8-40fc-91ff-c6fabdb87246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46642ed-e4c8-40fc-91ff-c6fabdb87246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db999c2f-4e9f-4d36-b327-01f6434df728', 'volume_name': 'volume-db999c2f-4e9f-4d36-b327-01f6434df728', 'volume_size': 1, 'image_id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52cab2649e4e455b5a659caa28782841', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33c505da6e374017842321eeccedcd7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a182a720c6894a018b37eb0137fde11f9a5f2e778cee9b52507109f42a687c28439d3e8228ae89adad4569dc9e66ff211751f1768392601960ee39adcadf845e', 'id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/029c61cd-f02b-42d0-a86c-1e75bca232db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f80cc9-eff1-4888-a504-142bfeccf4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f80cc9-eff1-4888-a504-142bfeccf4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544fc42d-bff2-44dc-a238-fdd326c93a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Volume db999c2f-4e9f-4d36-b327-01f6434df728: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db999c2f-4e9f-4d36-b327-01f6434df728', 'volume_size': 1, 'image_id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52cab2649e4e455b5a659caa28782841', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33c505da6e374017842321eeccedcd7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a182a720c6894a018b37eb0137fde11f9a5f2e778cee9b52507109f42a687c28439d3e8228ae89adad4569dc9e66ff211751f1768392601960ee39adcadf845e', 'id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/029c61cd-f02b-42d0-a86c-1e75bca232db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Trying to clone db999c2f-4e9f-4d36-b327-01f6434df728 from image 029c61cd-f02b-42d0-a86c-1e75bca232db at location (None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 08:04:25 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 08:04:25 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Image download 0.00 MB at 0.00 MB/s Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1cf5ea-73e1-42eb-b163-515f1efeccdd]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:25 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:25 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:25 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:25 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Flow 'volume_create_manager' (19dbfd86-77c8-42df-8b4f-0aa437236c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f414ee23-7005-4065-8cbb-33f3a3e9282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f414ee23-7005-4065-8cbb-33f3a3e9282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-5811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86ec4a0-2897-43cc-91e4-ac4c9588cb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05e0d118a141078633c6e750f6431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:26Z,use_quota=True,user_id='a046f15e10244b32821bca660ae41379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f68d14-0c3b-4439-a67c-b865ad2e180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f68d14-0c3b-4439-a67c-b865ad2e180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8d4b4e-b888-479e-89ad-8c0bcc6d15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8d4b4e-b888-479e-89ad-8c0bcc6d15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86ec4a0-2897-43cc-91e4-ac4c9588cb7e', 'volume_name': 'volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db72c2e-dca0-4f99-889b-ab33828c4e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db72c2e-dca0-4f99-889b-ab33828c4e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b025064c-f54e-4a32-9f0d-95abb4d9a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Volume d86ec4a0-2897-43cc-91e4-ac4c9588cb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e', 'volume_size': 1} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 1073741824" returned: 0 in 1.071s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:25 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 Jul 10 08:04:25 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:26 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 1 in 0.950s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Temporary image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 is fetched for user 2bee3c807dcd4e13b2dc7c4d568ec948. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c79b48-ff61-4e73-855e-dbae90ba2e1c]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:26 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 0 in 0.904s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:26 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:26 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:26 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-507398027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb9ad88-dfb3-49de-9d3c-031347c927a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:22Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Creating volume cfb9ad88-dfb3-49de-9d3c-031347c927a0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:26 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:26 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:26 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 1073741824 Jul 10 08:04:26 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85de7850-497c-4042-82bc-6a3d3fcbb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad06c1b-9f78-45e2-b431-82ecb4db8676', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e71ef7-c15f-4653-b50d-385f10e24cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Volume volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 (aad06c1b-9f78-45e2-b431-82ecb4db8676): created successfully Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e71ef7-c15f-4653-b50d-385f10e24cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (d1f1c5e4-0eda-4255-a273-c57a5a579f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f05c62f2-136d-4805-a540-3fa42e2cb4b3 tempest-CreateVolumesFromImageTest-1680497915 None] Created volume successfully. Jul 10 08:04:27 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:27 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 1 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Temporary image 029c61cd-f02b-42d0-a86c-1e75bca232db is fetched for user d68e067dd8f846bfb5a8ff5110253f40. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 08:04:27 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:27 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be45ed-c87f-4522-b68a-ec32a219a1a6]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:27 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 1073741824" returned: 0 in 0.900s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:27 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:27 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:27 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 Jul 10 08:04:27 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:28 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:28 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:28 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0" returned: 0 in 0.676s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.909s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692991419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08f8175-87e4-4401-8711-0df19a9508e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:22Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Creating volume d08f8175-87e4-4401-8711-0df19a9508e3 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:28 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192b4e3-20bc-4f90-8414-992394f95c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8961f9f-7db3-49b9-98e1-50be5c5fce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:28 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 1073741824 Jul 10 08:04:28 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Volume volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 (cfb9ad88-dfb3-49de-9d3c-031347c927a0): created successfully Jul 10 08:04:28 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8961f9f-7db3-49b9-98e1-50be5c5fce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:28 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (512a89af-90f5-4bd0-b81f-3ce4ed0bd625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-60c3302e-2ee6-4f9f-9256-1ceff6254ebc tempest-CreateVolumesFromImageTest-1680497915 None] Created volume successfully. Jul 10 08:04:28 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 1 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:29 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 1073741824" returned: 0 in 0.862s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:29 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 Jul 10 08:04:29 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:29 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3" returned: 0 in 0.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.945s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392580451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398b66eb-017e-44ef-8625-1cd202bd8f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99513c9afeb4ebab80c793ba55e9025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:23Z,use_quota=True,user_id='957bd084c14049e6ae0481b61b548e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Creating volume 398b66eb-017e-44ef-8625-1cd202bd8f6e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:29 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e 1073741824 Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae17755-6feb-466d-83c9-d18875bc1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08f8175-87e4-4401-8711-0df19a9508e3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:29 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722c408-50a1-4cbf-a25e-860ce6212fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Volume volume-d08f8175-87e4-4401-8711-0df19a9508e3 (d08f8175-87e4-4401-8711-0df19a9508e3): created successfully Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722c408-50a1-4cbf-a25e-860ce6212fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (0db1f876-6131-4ef9-9db9-db50ab4d52a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5932bfa1-b4f2-4524-8618-c007cefa9ce8 tempest-CreateVolumesFromImageTest-1680497915 None] Created volume successfully. Jul 10 08:04:30 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e 1073741824" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:30 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e Jul 10 08:04:30 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:31 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.418s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-5811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86ec4a0-2897-43cc-91e4-ac4c9588cb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f05e0d118a141078633c6e750f6431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:26Z,use_quota=True,user_id='a046f15e10244b32821bca660ae41379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Creating volume d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1a0234-5456-497d-a21b-478a1f4abd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398b66eb-017e-44ef-8625-1cd202bd8f6e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:31 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e 1073741824 Jul 10 08:04:31 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35ba3b-6208-48d8-bb97-ececa3b021b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Volume volume-398b66eb-017e-44ef-8625-1cd202bd8f6e (398b66eb-017e-44ef-8625-1cd202bd8f6e): created successfully Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35ba3b-6208-48d8-bb97-ececa3b021b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Flow 'volume_create_manager' (e56d9b58-ee46-4877-b491-c10a7c1c8729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4de9d3df-12ba-44bb-afe0-aa63b05b60b1 tempest-CreateVolumesFromImageTest-1680497915 None] Created volume successfully. Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-398b66eb-017e-44ef-8625-1cd202bd8f6e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-398b66eb-017e-44ef-8625-1cd202bd8f6e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-quobyte-398b66eb-017e-44ef-8625-1cd202bd8f6e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-398b66eb-017e-44ef-8625-1cd202bd8f6e" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc86ed7-5761-468b-ae9d-4cf335709e35]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:31 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e Jul 10 08:04:31 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:32 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e 1073741824" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:32 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e Jul 10 08:04:32 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:32 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e" returned: 0 in 0.781s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:32 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e Jul 10 08:04:32 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:32 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" returned: 0 in 0.638s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.808s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f9bade-19d7-4b53-a6e6-903bb16c5600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c5897dd1654c29b93ae4b9f018e71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:24Z,use_quota=True,user_id='2bee3c807dcd4e13b2dc7c4d568ec948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Creating volume c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:32 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:32 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1073741824 Jul 10 08:04:32 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b025064c-f54e-4a32-9f0d-95abb4d9a56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2a4c73-e3f4-4855-a1fd-0bf41d82bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Volume volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e (d86ec4a0-2897-43cc-91e4-ac4c9588cb7e): created successfully Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2a4c73-e3f4-4855-a1fd-0bf41d82bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Flow 'volume_create_manager' (19dbfd86-77c8-42df-8b4f-0aa437236c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aa6dad03-ec5b-49fe-8730-179d67eb89f6 tempest-CinderUnicodeTest-410322668 None] Created volume successfully. Jul 10 08:04:33 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-398b66eb-017e-44ef-8625-1cd202bd8f6e" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-398b66eb-017e-44ef-8625-1cd202bd8f6e" released by "delete_volume" :: held 1.536s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Created reservations ['d90d248a-30d2-4c2e-a18b-a8eb42489dd1', '1c122ba7-12aa-442e-9a3d-7e9e473fe789', '3052df58-8e74-4a6d-bf7f-c2b03dea67a9', '846cfef2-6ae6-4413-9589-147f8cb647a7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:33 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:33 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-d08f8175-87e4-4401-8711-0df19a9508e3-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:33 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1073741824" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-d08f8175-87e4-4401-8711-0df19a9508e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-quobyte-d08f8175-87e4-4401-8711-0df19a9508e3" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:33 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:33 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-d08f8175-87e4-4401-8711-0df19a9508e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64275e-3d62-43d0-be7e-b06ada5e8148]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:34 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 Jul 10 08:04:34 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:34 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Deleted volume successfully. Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6841b46f-7244-4c3d-8722-760238182572 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-398b66eb-017e-44ef-8625-1cd202bd8f6e-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:34 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.629s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db999c2f-4e9f-4d36-b327-01f6434df728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c505da6e374017842321eeccedcd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:25Z,use_quota=True,user_id='d68e067dd8f846bfb5a8ff5110253f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76875ab4-f702-4dfc-8b78-973d0d602e85),volume_type_id=76875ab4-f702-4dfc-8b78-973d0d602e85)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Creating volume db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:34 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:34 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1073741824 Jul 10 08:04:34 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Attempting download of 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}])) to volume c2f9bade-19d7-4b53-a6e6-903bb16c5600. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27082d-977d-44a8-8a29-6b4030ec90e0]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:34 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:34 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:34 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:34 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3 Jul 10 08:04:34 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:35 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:35 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1073741824" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:35 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:35 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:35 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d08f8175-87e4-4401-8711-0df19a9508e3" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-d08f8175-87e4-4401-8711-0df19a9508e3" released by "delete_volume" :: held 1.592s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:35 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv Jul 10 08:04:35 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Created reservations ['1f74d48f-81bd-41b3-9c72-c77a6feb3222', 'e2c8f13b-3f96-4d7d-9477-a56e01ba4fe1', 'f53ca4be-c1ea-4388-ac2c-5e41f4a86a79', 'd702a00c-8e90-4538-84ae-ce4f579d8b45'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:35 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:35 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-cfb9ad88-dfb3-49de-9d3c-031347c927a0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-cfb9ad88-dfb3-49de-9d3c-031347c927a0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:36 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.602s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:36 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv" returned: 1 in 0.843s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_i4akzlfv' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf954ca-575c-441b-8282-dbbc401231c3]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-quobyte-cfb9ad88-dfb3-49de-9d3c-031347c927a0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Creating offline snapshot 39b52800-75dc-485d-92c6-c9f8b8057da3 of volume d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Attempting download of 029c61cd-f02b-42d0-a86c-1e75bca232db ((None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}])) to volume db999c2f-4e9f-4d36-b327-01f6434df728. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-cfb9ad88-dfb3-49de-9d3c-031347c927a0" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b1fea-6387-49d2-b89b-6914d3eca8d5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[68425bd3-6fc4-4b49-aa3a-fe28db44ac2c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ded9b-22bd-4c76-8d95-534ea16b2842]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:36 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:36 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:36 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e Jul 10 08:04:36 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:36 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Deleted volume successfully. Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8dd7edeb-4ec2-41aa-9662-4e1b978f79b2 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-d08f8175-87e4-4401-8711-0df19a9508e3-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:36 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 Jul 10 08:04:36 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:36 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c Jul 10 08:04:36 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:36 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:36 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:37 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:37 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" returned: 0 in 1.029s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:37 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:37 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 1G Jul 10 08:04:37 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:37 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 0 in 1.166s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:37 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0 Jul 10 08:04:37 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:37 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.943s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:04:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:04:37 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c Jul 10 08:04:37 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:37 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD Jul 10 08:04:37 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:38 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-cfb9ad88-dfb3-49de-9d3c-031347c927a0" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-cfb9ad88-dfb3-49de-9d3c-031347c927a0" released by "delete_volume" :: held 1.793s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Created reservations ['a6428748-83b4-4aad-adb3-4b1a2583b2df', '3781657e-ebd2-4944-9025-00ebd7dcb70a', 'f0255d1b-ef8e-4425-a6ca-c007f5050f16', '03b0d198-e0e0-4f70-9278-9b77aa1d0c8a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:38 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c" returned: 1 in 0.843s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_029c61cd-f02b-42d0-a86c-1e75bca232db__t8i3l0c' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[677fdb02-5027-426d-a678-5d0b6b5aa7e9]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:38 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD" returned: 1 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:38 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:38 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:38 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:38 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:38 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:38 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-aad06c1b-9f78-45e2-b431-82ecb4db8676-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-aad06c1b-9f78-45e2-b431-82ecb4db8676-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:38 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 1G" returned: 0 in 1.149s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:38 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 Jul 10 08:04:38 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-quobyte-aad06c1b-9f78-45e2-b431-82ecb4db8676" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-aad06c1b-9f78-45e2-b431-82ecb4db8676" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cbde63-55ab-42e0-a669-324dbe154293]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:38 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 Jul 10 08:04:38 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:39 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.989s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Deleted volume successfully. Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55881d9a-e1cc-4eae-a3f4-bf5c5979db2c tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-cfb9ad88-dfb3-49de-9d3c-031347c927a0-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:39 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 0 in 1.037s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b1fcd40-c74c-45ec-bc0c-3c7386c90b08_iwktaydfdevstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:04:39 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:39 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1G Jul 10 08:04:39 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:39 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:39 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:39 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 is being set with open permissions: ugo+rw Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:39 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 Jul 10 08:04:39 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:39 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD Jul 10 08:04:39 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:39 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676" returned: 0 in 0.964s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:39 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676 Jul 10 08:04:39 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:40 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 1G" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a1150-06ac-487d-a095-23bcccab90b9]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:40 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:40 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD" returned: 1 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] 029c61cd-f02b-42d0-a86c-1e75bca232db was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:40 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info Jul 10 08:04:40 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:40 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:40 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:40 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:40 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:40 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aad06c1b-9f78-45e2-b431-82ecb4db8676" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-aad06c1b-9f78-45e2-b431-82ecb4db8676" released by "delete_volume" :: held 1.782s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Created reservations ['ce44a879-74f5-4283-a128-e85d3ccad870', '5cf68f60-29f3-4c3b-b19b-58be1f4bd306', 'ea36fb9e-a734-4656-9270-a0ff03da05f7', '0b55b308-d9c0-4ee6-a9dc-f885b5c739fb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:40 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:40 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-5cf2bc77-f1ab-40fe-ae81-fef4ada57549-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-5cf2bc77-f1ab-40fe-ae81-fef4ada57549-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "cinder-quobyte-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb7692-ac7c-421b-a660-fab914724d94]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:41 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info" returned: 0 in 0.971s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info is being set with open permissions: ugo+rw Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:41 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 Jul 10 08:04:41 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:41 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 0 in 1.097s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:41 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info Jul 10 08:04:41 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:41 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 0 in 1.032s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_029c61cd-f02b-42d0-a86c-1e75bca232db_y0dd26dkdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:04:41 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:41 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1G Jul 10 08:04:41 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:41 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:41 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:41 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Deleted volume successfully. Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8781783e-6a17-48e4-aa9a-8a6283d45f8d tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-aad06c1b-9f78-45e2-b431-82ecb4db8676-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:41 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:41 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.info" returned: 0 in 0.818s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:41 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549 Jul 10 08:04:41 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.893s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:42 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 1G" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:42 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 1 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Downloaded image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}])) to volume c2f9bade-19d7-4b53-a6e6-903bb16c5600 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Temporary image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 for user 2bee3c807dcd4e13b2dc7c4d568ec948 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Marking volume c2f9bade-19d7-4b53-a6e6-903bb16c5600 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 08:04:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fe38c91f-f424-4772-9263-5fbe7dbc638f tempest-CinderUnicodeTest-410322668 None] Create snapshot completed successfully Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Copying metadata from image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 to c2f9bade-19d7-4b53-a6e6-903bb16c5600. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Creating volume glance metadata for volume c2f9bade-19d7-4b53-a6e6-903bb16c5600 backed by image 1b1fcd40-c74c-45ec-bc0c-3c7386c90b08 with: {'image_id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2eed32701149e045e4b74cc14b17cbfc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a0799-7764-4738-9d17-dbc822d2c5bd]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b82895-5b7e-42ca-a5f4-7c04b29ad273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600', 'volume_size': 1, 'image_id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2eed32701149e045e4b74cc14b17cbfc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7c5897dd1654c29b93ae4b9f018e71d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac9d30ecb331ef1191c1e77238df9263aa1bbad41402cc6355ee35224c67664f8590ac144e4f4ed610a3f54f34edc143fba394ec97efe1a64d1eee7187f80f19', 'id': '1b1fcd40-c74c-45ec-bc0c-3c7386c90b08', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b1fcd40-c74c-45ec-bc0c-3c7386c90b08/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a7e78d-7238-4729-9442-90984d865eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Volume volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 (c2f9bade-19d7-4b53-a6e6-903bb16c5600): created successfully Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a7e78d-7238-4729-9442-90984d865eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Flow 'volume_create_manager' (4999d8a7-23bb-48b6-95fc-a50c652b851e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8a6516c2-3a0a-4f20-989b-827589d4122c tempest-VolumeImageDependencyTests-118378547 None] Created volume successfully. Jul 10 08:04:42 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:42 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Acquiring lock "cinder-c2f9bade-19d7-4b53-a6e6-903bb16c5600-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "cinder-c2f9bade-19d7-4b53-a6e6-903bb16c5600-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Acquiring lock "cinder-quobyte-c2f9bade-19d7-4b53-a6e6-903bb16c5600" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "cinder-quobyte-c2f9bade-19d7-4b53-a6e6-903bb16c5600" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1adbb-4102-441d-b4a6-f2fe083f6c77]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:42 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:42 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:42 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" returned: 0 in 0.721s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-quobyte-5cf2bc77-f1ab-40fe-ae81-fef4ada57549" released by "delete_volume" :: held 1.744s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Created reservations ['57545eb8-82c2-4e49-a7a4-4241111a9ba1', '10333dda-3021-4638-a9a2-ca01b6969c16', 'a6f3b15d-2baa-42ee-b87a-db2cde3ac6a8', 'b462fcf7-f929-45a0-a9bf-261129dc0d6a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:42 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:42 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:42 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-39b52800-75dc-485d-92c6-c9f8b8057da3-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-39b52800-75dc-485d-92c6-c9f8b8057da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:43 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:43 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-quobyte-39b52800-75dc-485d-92c6-c9f8b8057da3" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-39b52800-75dc-485d-92c6-c9f8b8057da3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Deleting offline snapshot 39b52800-75dc-485d-92c6-c9f8b8057da3 of volume d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] snapshot_file for this snap is: volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[884fa2cc-a998-4301-9425-1e00e5c3278d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:43 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 Jul 10 08:04:43 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:43 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 0 in 0.941s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:43 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Deleted volume successfully. Jul 10 08:04:43 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:43 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9a07f6a2-df90-4b7d-96ba-6129069ef158 tempest-CreateVolumesFromImageTest-1680497915 None] Lock "cinder-5cf2bc77-f1ab-40fe-ae81-fef4ada57549-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:43 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 1 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Downloaded image 029c61cd-f02b-42d0-a86c-1e75bca232db ((None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}])) to volume db999c2f-4e9f-4d36-b327-01f6434df728 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Temporary image 029c61cd-f02b-42d0-a86c-1e75bca232db for user d68e067dd8f846bfb5a8ff5110253f40 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Marking volume db999c2f-4e9f-4d36-b327-01f6434df728 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Copying metadata from image 029c61cd-f02b-42d0-a86c-1e75bca232db to db999c2f-4e9f-4d36-b327-01f6434df728. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Creating volume glance metadata for volume db999c2f-4e9f-4d36-b327-01f6434df728 backed by image 029c61cd-f02b-42d0-a86c-1e75bca232db with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '52cab2649e4e455b5a659caa28782841', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544fc42d-bff2-44dc-a238-fdd326c93a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db999c2f-4e9f-4d36-b327-01f6434df728', 'volume_size': 1, 'image_id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/029c61cd-f02b-42d0-a86c-1e75bca232db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52cab2649e4e455b5a659caa28782841', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33c505da6e374017842321eeccedcd7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a182a720c6894a018b37eb0137fde11f9a5f2e778cee9b52507109f42a687c28439d3e8228ae89adad4569dc9e66ff211751f1768392601960ee39adcadf845e', 'id': '029c61cd-f02b-42d0-a86c-1e75bca232db', 'created_at': datetime.datetime(2026, 7, 10, 6, 4, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 6, 4, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/029c61cd-f02b-42d0-a86c-1e75bca232db/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4910cc-dddc-420a-b26c-419af1908a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Volume volume-db999c2f-4e9f-4d36-b327-01f6434df728 (db999c2f-4e9f-4d36-b327-01f6434df728): created successfully Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4910cc-dddc-420a-b26c-419af1908a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Flow 'volume_create_manager' (2c82863f-c3ce-416d-8603-611df709e366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d7fa4e14-2a4c-4259-98d4-5e15c45f3c77 tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Created volume successfully. Jul 10 08:04:44 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3" returned: 0 in 1.087s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fbda4a-85bf-486c-aec2-69251b0bc819]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Acquiring lock "cinder-db999c2f-4e9f-4d36-b327-01f6434df728-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "cinder-db999c2f-4e9f-4d36-b327-01f6434df728-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:44 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 1 in 1.010s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:44 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e Jul 10 08:04:44 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:44 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600 Jul 10 08:04:44 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Acquiring lock "cinder-quobyte-db999c2f-4e9f-4d36-b327-01f6434df728" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "cinder-quobyte-db999c2f-4e9f-4d36-b327-01f6434df728" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7068bdcb-6a53-437b-88cb-94a0d422f4d3]: (4, 'raw') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:44 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:44 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:45 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c2f9bade-19d7-4b53-a6e6-903bb16c5600" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "cinder-quobyte-c2f9bade-19d7-4b53-a6e6-903bb16c5600" released by "delete_volume" :: held 2.798s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:45 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Created reservations ['56cab2de-90b7-468a-8264-b3a76b0b2c57', '23ead215-7589-4213-8995-56ca4db742d7', 'a7188482-3623-4477-b634-ba460b071cd5', '21c0a281-5022-42fd-bfd0-5b5ebec64fcf'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:45 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 Jul 10 08:04:45 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:45 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:45 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:45 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 0 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:45 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:45 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:46 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.919s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Deleted volume successfully. Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5a858da2-35c2-4437-aeda-c2df9dac31d6 tempest-VolumeImageDependencyTests-118378547 None] Lock "cinder-c2f9bade-19d7-4b53-a6e6-903bb16c5600-delete_volume" released by "delete_volume" :: held 4.012s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:46 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3" returned: 0 in 1.171s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:46 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3 Jul 10 08:04:46 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:46 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 1 in 0.981s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:46 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728 Jul 10 08:04:46 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (44af17ce-e343-4931-a51a-421242ae4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87facf07-a354-4ef9-acbc-b5a1e644ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87facf07-a354-4ef9-acbc-b5a1e644ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1391454686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be10639-6f62-4351-b19c-efa160940c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:47Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f176e25b-b8f1-45c7-8efc-4ee9983e50f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f176e25b-b8f1-45c7-8efc-4ee9983e50f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb0dcc-0a3d-45d4-a402-31025b578b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb0dcc-0a3d-45d4-a402-31025b578b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be10639-6f62-4351-b19c-efa160940c29', 'volume_name': 'volume-4be10639-6f62-4351-b19c-efa160940c29', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c706dbf3-7a0f-4c14-a7a9-b4d161b90ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c706dbf3-7a0f-4c14-a7a9-b4d161b90ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32fa9dd-71ad-4f4b-b841-492316fc5b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume 4be10639-6f62-4351-b19c-efa160940c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be10639-6f62-4351-b19c-efa160940c29', 'volume_size': 1} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1391454686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be10639-6f62-4351-b19c-efa160940c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:47Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume 4be10639-6f62-4351-b19c-efa160940c29 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:46 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 1073741824 Jul 10 08:04:46 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:47 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e.39b52800-75dc-485d-92c6-c9f8b8057da3" returned: 0 in 0.859s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-39b52800-75dc-485d-92c6-c9f8b8057da3" released by "_delete_snapshot" :: held 4.246s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" released by "delete_snapshot" :: held 4.282s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:47 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-db999c2f-4e9f-4d36-b327-01f6434df728" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "cinder-quobyte-db999c2f-4e9f-4d36-b327-01f6434df728" released by "delete_volume" :: held 2.886s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Created reservations ['8b565084-2b29-44de-bf7b-acfff4686b07', '7fa2a612-8003-41de-b325-cd27a799230e', '9ffbbd24-cec1-4699-a9aa-62622f51bb7a', 'e490fe15-6e9f-406b-9806-efb8cd52442f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Created reservations ['0bf2ebef-5363-43f0-9c20-033845165576', '3f98480a-522c-4e70-8f96-95fa446eae7e', '93275024-6125-4c4e-94ea-7e40b67311d5', '181630d1-553d-48dc-965c-7409d3a203f1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Delete snapshot completed successfully. Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d742931c-3748-4f0c-8704-653d2d80318c tempest-CinderUnicodeTest-410322668 None] Lock "cinder-39b52800-75dc-485d-92c6-c9f8b8057da3-delete_snapshot" released by "delete_snapshot" :: held 4.511s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:47 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:47 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:48 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 1073741824" returned: 0 in 1.147s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:48 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 Jul 10 08:04:48 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "cinder-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:48 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.016s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Deleted volume successfully. Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be5b85-b47f-486e-b89f-f2078d521cd8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2849e072-c8ff-4556-81fd-00dc9f39418c tempest-VolumeAndVolumeTypeFromImageTest-459462855 None] Lock "cinder-db999c2f-4e9f-4d36-b327-01f6434df728-delete_volume" released by "delete_volume" :: held 4.257s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:48 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e Jul 10 08:04:48 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:49 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32fa9dd-71ad-4f4b-b841-492316fc5b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be10639-6f62-4351-b19c-efa160940c29', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a09f02f-b4f9-4163-aadb-e43f2b2e88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-4be10639-6f62-4351-b19c-efa160940c29 (4be10639-6f62-4351-b19c-efa160940c29): created successfully Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a09f02f-b4f9-4163-aadb-e43f2b2e88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (44af17ce-e343-4931-a51a-421242ae4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9aceeb07-8e0b-48eb-a4fb-fd95e46e4277 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:04:49 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" returned: 0 in 0.937s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:49 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e Jul 10 08:04:49 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:50 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e" released by "delete_volume" :: held 1.787s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Created reservations ['781b63c4-de8b-4fcb-9904-6455f9c6489d', '0dd9689e-aca4-493b-88a0-330787ee61bc', '5f23ac6d-fdfa-49af-bdc1-37f2c5651dcb', '0cf54f57-beea-47ff-8ea5-f10af4d723eb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:50 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:50 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (9043a31d-8972-4b3e-971b-c896f98fa166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36ba87-83f0-48e5-a027-9797c38b112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36ba87-83f0-48e5-a027-9797c38b112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249364822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf5b399-452e-429d-a7dd-6b23e5311f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:51Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d2885d-c109-4421-a4d5-67d11cf418e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d2885d-c109-4421-a4d5-67d11cf418e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd13580-0b51-4dc7-916c-3e06880916e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd13580-0b51-4dc7-916c-3e06880916e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf5b399-452e-429d-a7dd-6b23e5311f4a', 'volume_name': 'volume-abf5b399-452e-429d-a7dd-6b23e5311f4a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998ce972-1c02-4bf2-b071-c10075cac4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998ce972-1c02-4bf2-b071-c10075cac4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812ed7e-65ac-4112-a820-c60b96680718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume abf5b399-452e-429d-a7dd-6b23e5311f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf5b399-452e-429d-a7dd-6b23e5311f4a', 'volume_size': 1} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249364822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf5b399-452e-429d-a7dd-6b23e5311f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:51Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume abf5b399-452e-429d-a7dd-6b23e5311f4a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:50 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a 1073741824 Jul 10 08:04:50 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (37ed2d24-69f4-4c0f-a8e6-df8b8921e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee428632-89a5-4a94-9f37-5fea9a4433f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee428632-89a5-4a94-9f37-5fea9a4433f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040396477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ce8d9-4118-47c3-b050-b6aa0ea4e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:51Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c97c66-fd45-411c-bac1-b3a2c063d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c97c66-fd45-411c-bac1-b3a2c063d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d4e9ca-a9c0-43bd-bfb6-3c38ffc49cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d4e9ca-a9c0-43bd-bfb6-3c38ffc49cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9ce8d9-4118-47c3-b050-b6aa0ea4e209', 'volume_name': 'volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91a0cf5-629e-4f2f-b87f-f67448aeb4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91a0cf5-629e-4f2f-b87f-f67448aeb4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889e0136-d312-45a9-a0fb-bfb18d46dbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume 4c9ce8d9-4118-47c3-b050-b6aa0ea4e209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209', 'volume_size': 1} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-e5d592a6-84db-47d9-90f4-c5862152bd38-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "cinder-e5d592a6-84db-47d9-90f4-c5862152bd38-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Acquiring lock "cinder-quobyte-e5d592a6-84db-47d9-90f4-c5862152bd38" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-e5d592a6-84db-47d9-90f4-c5862152bd38" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc40231-6d31-4a0a-991b-1d3db87bf8d6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (12502f86-e5a1-4a8d-8455-391a399ce7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69899fb-e826-41d7-a207-4365adad31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69899fb-e826-41d7-a207-4365adad31ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365820434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2256784-8991-4b6f-91d0-1cec1616f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:52Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 Jul 10 08:04:51 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06922f7a-4c10-483f-9242-9c2e289ad18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06922f7a-4c10-483f-9242-9c2e289ad18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fda5ac9-912c-4ab6-b8fc-304cc1600fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fda5ac9-912c-4ab6-b8fc-304cc1600fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2256784-8991-4b6f-91d0-1cec1616f6cd', 'volume_name': 'volume-f2256784-8991-4b6f-91d0-1cec1616f6cd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb7a691-6a0f-408b-8dfc-eaabc203acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb7a691-6a0f-408b-8dfc-eaabc203acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e458e4ce-0f22-4eb2-8204-34ed56be8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume f2256784-8991-4b6f-91d0-1cec1616f6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2256784-8991-4b6f-91d0-1cec1616f6cd', 'volume_size': 1} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.353s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:51 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Deleted volume successfully. Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-709d82eb-34c9-4c67-9daa-056ea6c94f67 tempest-CinderUnicodeTest-410322668 None] Lock "cinder-d86ec4a0-2897-43cc-91e4-ac4c9588cb7e-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:52 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a 1073741824" returned: 0 in 1.526s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:52 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a Jul 10 08:04:52 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (4832b780-0dd7-4c62-aded-9f8c7ac038b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bded139-23a1-4c24-a60c-2a5269d6102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bded139-23a1-4c24-a60c-2a5269d6102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956072542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37d4032-356a-4ad4-bc2b-f613ed416685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:52Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78e580a-c170-4409-bc93-fe5f5242e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78e580a-c170-4409-bc93-fe5f5242e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb384e-a21a-454b-b822-246d59b90e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb384e-a21a-454b-b822-246d59b90e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37d4032-356a-4ad4-bc2b-f613ed416685', 'volume_name': 'volume-c37d4032-356a-4ad4-bc2b-f613ed416685', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4315d24c-7246-44a5-a137-2e7b8265beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4315d24c-7246-44a5-a137-2e7b8265beee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b021512-46ff-4f98-a7ea-97d5023a71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume c37d4032-356a-4ad4-bc2b-f613ed416685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37d4032-356a-4ad4-bc2b-f613ed416685', 'volume_size': 1} Jul 10 08:04:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (bdf49cbe-62d8-42f2-9334-b3a1cb760ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9269c9-357e-4fe3-9651-07b305dfc2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9269c9-357e-4fe3-9651-07b305dfc2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-25263594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9857a7a5-b536-48e5-b89c-1fd8b97f38b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:53Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560c62ce-463b-4f61-8a3e-390f5bac7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560c62ce-463b-4f61-8a3e-390f5bac7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06433c-f575-496c-9644-2355f18a0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06433c-f575-496c-9644-2355f18a0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9857a7a5-b536-48e5-b89c-1fd8b97f38b8', 'volume_name': 'volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7d77de-ceac-408f-a125-1f2a31b6c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7d77de-ceac-408f-a125-1f2a31b6c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109a7e40-4c66-4635-b731-90cc1d6af313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume 9857a7a5-b536-48e5-b89c-1fd8b97f38b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8', 'volume_size': 1} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38" returned: 0 in 1.523s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:53 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38 Jul 10 08:04:53 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:53 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040396477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ce8d9-4118-47c3-b050-b6aa0ea4e209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:51Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume 4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812ed7e-65ac-4112-a820-c60b96680718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf5b399-452e-429d-a7dd-6b23e5311f4a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197263f-7167-4441-bab5-cb52dcfb8220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:53 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 1073741824 Jul 10 08:04:53 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-abf5b399-452e-429d-a7dd-6b23e5311f4a (abf5b399-452e-429d-a7dd-6b23e5311f4a): created successfully Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197263f-7167-4441-bab5-cb52dcfb8220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (9043a31d-8972-4b3e-971b-c896f98fa166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f9cfbb2c-ad5c-4bbd-856a-f792c79fb9b5 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:04:54 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e5d592a6-84db-47d9-90f4-c5862152bd38" returned: 0 in 0.938s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "cinder-quobyte-e5d592a6-84db-47d9-90f4-c5862152bd38" released by "delete_volume" :: held 2.552s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Created reservations ['74d944b7-1482-4cf2-b102-6df1b3804709', 'e604b5db-23c5-4b90-86a3-7878efe1fc4d', 'd038c92c-b4f9-4215-87ad-4ea2abe0f27f', '4e395ca5-4fa1-4e77-acf7-5739809e5845'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:54 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 1073741824" returned: 0 in 1.141s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:54 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:04:54 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (1617514a-6509-46c2-ae71-9fa817c76b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3925e5-6d27-4510-a751-e19500ca8bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3925e5-6d27-4510-a751-e19500ca8bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439086058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8630d994-8aea-4444-80ec-e889a505c89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:54Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6121247f-c8f5-455a-8094-2ab189672241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6121247f-c8f5-455a-8094-2ab189672241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20e9542-9dfa-4114-9e68-afdc298d20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20e9542-9dfa-4114-9e68-afdc298d20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8630d994-8aea-4444-80ec-e889a505c89b', 'volume_name': 'volume-8630d994-8aea-4444-80ec-e889a505c89b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:54 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 Jul 10 08:04:54 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08324574-c67d-4669-b183-22a6affed947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08324574-c67d-4669-b183-22a6affed947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3df65b-52bf-4802-a5fa-24f401f5e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume 8630d994-8aea-4444-80ec-e889a505c89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8630d994-8aea-4444-80ec-e889a505c89b', 'volume_size': 1} Jul 10 08:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:55 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:04:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Deleted volume successfully. Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12fe0823-4ac0-4c9b-9381-5d10be0ef25a tempest-CinderUnicodeTest-410322668 None] Lock "cinder-e5d592a6-84db-47d9-90f4-c5862152bd38-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:04:55 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365820434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2256784-8991-4b6f-91d0-1cec1616f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:52Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume f2256784-8991-4b6f-91d0-1cec1616f6cd {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:55 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd 1073741824 Jul 10 08:04:55 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889e0136-d312-45a9-a0fb-bfb18d46dbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c38626b-254d-4817-bd79-77c47268236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 (4c9ce8d9-4118-47c3-b050-b6aa0ea4e209): created successfully Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c38626b-254d-4817-bd79-77c47268236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (37ed2d24-69f4-4c0f-a8e6-df8b8921e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8b54d03a-ebac-4e99-9319-8c61d21de5a9 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:04:56 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd 1073741824" returned: 0 in 1.038s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:56 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd Jul 10 08:04:56 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:57 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.322s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956072542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37d4032-356a-4ad4-bc2b-f613ed416685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:52Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume c37d4032-356a-4ad4-bc2b-f613ed416685 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:57 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 1073741824 Jul 10 08:04:57 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e458e4ce-0f22-4eb2-8204-34ed56be8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2256784-8991-4b6f-91d0-1cec1616f6cd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdb7749-6189-422d-96c6-2e7393de78b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-f2256784-8991-4b6f-91d0-1cec1616f6cd (f2256784-8991-4b6f-91d0-1cec1616f6cd): created successfully Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdb7749-6189-422d-96c6-2e7393de78b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (12502f86-e5a1-4a8d-8455-391a399ce7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3ac2039b-46e5-495d-b142-73603dc9630f tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (74276532-8c24-437e-bbac-6d1d8a1e1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0583812d-91b9-43ca-8fd8-bc85ec5da2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0583812d-91b9-43ca-8fd8-bc85ec5da2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438054495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c637d7d7-5ab7-4a66-add5-37148901399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:57Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39bd813-4892-4d01-bb3f-d8931ea6dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39bd813-4892-4d01-bb3f-d8931ea6dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc1438c-96db-4568-ab43-e0b1f867ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc1438c-96db-4568-ab43-e0b1f867ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c637d7d7-5ab7-4a66-add5-37148901399a', 'volume_name': 'volume-c637d7d7-5ab7-4a66-add5-37148901399a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7773eb-3d2f-49ca-ae80-eae03d446038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7773eb-3d2f-49ca-ae80-eae03d446038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5691f73e-246f-4b49-8d34-9b107458fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Volume c637d7d7-5ab7-4a66-add5-37148901399a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c637d7d7-5ab7-4a66-add5-37148901399a', 'volume_size': 1} Jul 10 08:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:58 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 1073741824" returned: 0 in 0.924s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:58 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 Jul 10 08:04:58 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:58 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.606s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-25263594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9857a7a5-b536-48e5-b89c-1fd8b97f38b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa68fc4f82c4f1ebbb500ca69cc8926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:53Z,use_quota=True,user_id='11baedda03a34daf8eb07d9146e4a063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Creating volume 9857a7a5-b536-48e5-b89c-1fd8b97f38b8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:04:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:58 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 1073741824 Jul 10 08:04:58 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b021512-46ff-4f98-a7ea-97d5023a71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37d4032-356a-4ad4-bc2b-f613ed416685', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b09c01c-340a-40dd-bd79-a450570aca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:04:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-c37d4032-356a-4ad4-bc2b-f613ed416685 (c37d4032-356a-4ad4-bc2b-f613ed416685): created successfully Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b09c01c-340a-40dd-bd79-a450570aca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (4832b780-0dd7-4c62-aded-9f8c7ac038b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:04:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7c1eaabb-36db-492b-8bc7-42aa52b58325 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:04:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0c977790-1373-4cbf-a0c3-edcb3db2fe28 tempest-ProjectAdminTests-1006424177 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 08:04:59 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 10 08:04:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 1073741824" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:04:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:04:59 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 Jul 10 08:04:59 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:00 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.807s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1439086058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8630d994-8aea-4444-80ec-e889a505c89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:54Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume 8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:00 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b 1073741824 Jul 10 08:05:00 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109a7e40-4c66-4635-b731-90cc1d6af313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11774eb8-95cd-4570-b621-b8da31a55e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Volume volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 (9857a7a5-b536-48e5-b89c-1fd8b97f38b8): created successfully Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11774eb8-95cd-4570-b621-b8da31a55e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Flow 'volume_create_manager' (bdf49cbe-62d8-42f2-9334-b3a1cb760ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f23d4573-7c94-4d73-86df-fa8881730e96 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created volume successfully. Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-9857a7a5-b536-48e5-b89c-1fd8b97f38b8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-9857a7a5-b536-48e5-b89c-1fd8b97f38b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d8bd0-695b-4f50-97d5-1cee245fd8f9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:01 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 Jul 10 08:05:01 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:01 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b 1073741824" returned: 0 in 0.995s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:01 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b Jul 10 08:05:01 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:01 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:01 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8 Jul 10 08:05:01 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:02 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b" returned: 0 in 0.715s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438054495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c637d7d7-5ab7-4a66-add5-37148901399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:04:57Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Creating volume c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3df65b-52bf-4802-a5fa-24f401f5e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8630d994-8aea-4444-80ec-e889a505c89b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6ac870-7683-45c9-8494-ee57628ca941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:02 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a 1073741824 Jul 10 08:05:02 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-8630d994-8aea-4444-80ec-e889a505c89b (8630d994-8aea-4444-80ec-e889a505c89b): created successfully Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6ac870-7683-45c9-8494-ee57628ca941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (1617514a-6509-46c2-ae71-9fa817c76b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0cc5d37-1538-4189-bd74-6355036f578d tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:02 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" returned: 0 in 0.675s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-9857a7a5-b536-48e5-b89c-1fd8b97f38b8" released by "delete_volume" :: held 1.590s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['77f973f8-2c56-4bab-9cb8-0f940483affe', 'bafe3e09-d8aa-4aec-a141-ed1c5c6acc09', '454745fa-8c1f-4a78-a5ef-388ac5ce6054', '06fb4874-7327-4ea2-9928-4fe14c0a27fa'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:02 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:02 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:03 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a 1073741824" returned: 0 in 0.975s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-c37d4032-356a-4ad4-bc2b-f613ed416685-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:03 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a Jul 10 08:05:03 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-c37d4032-356a-4ad4-bc2b-f613ed416685-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-c37d4032-356a-4ad4-bc2b-f613ed416685" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-c37d4032-356a-4ad4-bc2b-f613ed416685" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ae902-b637-458c-a94f-3d3f35014413]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:03 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.874s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bc094acb-57b9-4010-b6d4-fd3417635e66 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-9857a7a5-b536-48e5-b89c-1fd8b97f38b8-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:03 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 Jul 10 08:05:03 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:04 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.730s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating offline snapshot 1f881437-6f31-4924-b318-2f7cecf9a7e4 of volume 8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5691f73e-246f-4b49-8d34-9b107458fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c637d7d7-5ab7-4a66-add5-37148901399a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52512a0-5154-42d5-a315-38f03d96860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a014cd-b9c6-4383-8f9a-86b7cf62e721]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Volume volume-c637d7d7-5ab7-4a66-add5-37148901399a (c637d7d7-5ab7-4a66-add5-37148901399a): created successfully Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52512a0-5154-42d5-a315-38f03d96860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (74276532-8c24-437e-bbac-6d1d8a1e1827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-56ea295e-c40b-48bb-a350-670d89d5c6be tempest-ProjectReaderTests-1532914144 None] Created volume successfully. Jul 10 08:05:04 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b Jul 10 08:05:04 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:04 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:04 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685 Jul 10 08:05:04 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:04 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b" returned: 0 in 0.837s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:04 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c37d4032-356a-4ad4-bc2b-f613ed416685" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:04 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 1G Jul 10 08:05:04 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-c37d4032-356a-4ad4-bc2b-f613ed416685" released by "delete_volume" :: held 1.574s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['9e779f7f-c6a2-428e-bc54-1d6a2dd772c4', '10ade4fb-798c-480c-9efb-0095ac37da07', 'f777ee1e-b53d-40d3-9bb4-abcbb7f4bf4a', '9a36e75c-c8bb-4b89-b05d-a4a04ccb3af0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:05 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:05 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-f2256784-8991-4b6f-91d0-1cec1616f6cd-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-f2256784-8991-4b6f-91d0-1cec1616f6cd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-f2256784-8991-4b6f-91d0-1cec1616f6cd" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-f2256784-8991-4b6f-91d0-1cec1616f6cd" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b9037-9a80-4c5a-b8e1-a9636afa4993]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:05 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd Jul 10 08:05:05 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:05 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 1G" returned: 0 in 1.021s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8630d994-8aea-4444-80ec-e889a505c89b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:05 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8630d994-8aea-4444-80ec-e889a505c89b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 Jul 10 08:05:05 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:06 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.897s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c77fad23-54d3-4983-b6af-34d1c334cd60 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-c37d4032-356a-4ad4-bc2b-f613ed416685-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:06 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:06 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd Jul 10 08:05:06 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:06 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8630d994-8aea-4444-80ec-e889a505c89b -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:06 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 is being set with open permissions: ugo+rw Jul 10 08:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:06 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 Jul 10 08:05:06 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:07 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2256784-8991-4b6f-91d0-1cec1616f6cd" returned: 0 in 0.681s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-f2256784-8991-4b6f-91d0-1cec1616f6cd" released by "delete_volume" :: held 1.603s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['fd5ae8b5-362b-4bf9-8654-b4bc36e03850', '98787f48-ed9b-421e-9abd-3524ff753172', '8811d023-edec-4b2f-ab76-72a2a7c0ce92', '1b48d80a-24d0-4f26-be6c-3d495afba75d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:07 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:07 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info Jul 10 08:05:07 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:07 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:07 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db189b79-e12b-4949-b5ec-4ffea85b33ba]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:08 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 Jul 10 08:05:08 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:08 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info is being set with open permissions: ugo+rw Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:08 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info Jul 10 08:05:08 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:08 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9402bda-6116-4306-9de1-70a3ec367aa6 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-f2256784-8991-4b6f-91d0-1cec1616f6cd-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:08 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:08 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209 Jul 10 08:05:08 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:08 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.info" returned: 0 in 0.699s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.635s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Creating offline snapshot 20733707-f293-43e5-8298-c716d00762fd of volume c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:05:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-86b37a46-3afc-468f-843e-185e325a43b5 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Create snapshot completed successfully Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa270f7-37d6-4219-99c2-dac5a8f166e9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:09 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a Jul 10 08:05:09 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:09 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209" released by "delete_volume" :: held 1.655s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['9f030f16-4dd1-452c-afed-809cceb7bd09', '0dcaaf2a-8273-4d41-942e-2a383688a2de', '8debe7dc-3017-403f-b0a9-f85a1c981b5e', 'b8f398cc-7c42-4737-90f3-f48da9956ae0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:09 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:09 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:09 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a" returned: 0 in 0.968s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:09 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd 1G Jul 10 08:05:09 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (27c2d81c-7e68-4a53-94df-1b7b5c710286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191cd463-b983-4e43-8b75-2b2d4c4bfa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191cd463-b983-4e43-8b75-2b2d4c4bfa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500372649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb0d432-e875-43fc-883e-abb145491414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:10Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e461e6-54fa-4f90-9c67-358f2a542914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e461e6-54fa-4f90-9c67-358f2a542914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac1ad32-40e3-4b6c-aa71-5ad831ec0977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac1ad32-40e3-4b6c-aa71-5ad831ec0977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb0d432-e875-43fc-883e-abb145491414', 'volume_name': 'volume-aeb0d432-e875-43fc-883e-abb145491414', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7383b9ce-8d0e-47f9-b284-80d6d265799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7383b9ce-8d0e-47f9-b284-80d6d265799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4006ac-54b4-4651-85bd-0758298da71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume aeb0d432-e875-43fc-883e-abb145491414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb0d432-e875-43fc-883e-abb145491414', 'volume_size': 1} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-abf5b399-452e-429d-a7dd-6b23e5311f4a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-abf5b399-452e-429d-a7dd-6b23e5311f4a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-abf5b399-452e-429d-a7dd-6b23e5311f4a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-abf5b399-452e-429d-a7dd-6b23e5311f4a" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f3872-9d0e-4335-85f0-4dfd5e5cc885]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:10 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a Jul 10 08:05:10 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (311c87ce-7693-47e9-9763-03a062c8e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a210324-ec9a-4be4-acc2-953f437f96db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.183s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a210324-ec9a-4be4-acc2-953f437f96db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650597469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5acd6-d17f-4be2-9f50-5e2c886e9a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:11Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20133c25-c0b0-4e2b-ae30-8038e0e76dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20133c25-c0b0-4e2b-ae30-8038e0e76dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa4efa3-dc8f-4d79-a5d0-365422ddad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa4efa3-dc8f-4d79-a5d0-365422ddad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a5acd6-d17f-4be2-9f50-5e2c886e9a08', 'volume_name': 'volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce72e532-807e-448e-930e-8d14d71f73eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce72e532-807e-448e-930e-8d14d71f73eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bf1001-8d2f-47fa-a181-c0420104b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume 05a5acd6-d17f-4be2-9f50-5e2c886e9a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08', 'volume_size': 1} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a364612b-7426-477e-a86e-f2e07c156372 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-4c9ce8d9-4118-47c3-b050-b6aa0ea4e209-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:11 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd 1G" returned: 0 in 1.388s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c637d7d7-5ab7-4a66-add5-37148901399a -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:11 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c637d7d7-5ab7-4a66-add5-37148901399a -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd Jul 10 08:05:11 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (3aab94b4-7a4d-4612-92cc-faeb59da681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1661736b-b265-46cc-907c-0d931bd2ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1661736b-b265-46cc-907c-0d931bd2ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501061343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ac5d5-e7f3-4927-8a34-69bc073046bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:11Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f5dd65-41c7-4e2b-8883-743a8c002a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f5dd65-41c7-4e2b-8883-743a8c002a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e22c8ff-c4e9-4ba0-b9ed-6b2cccc6d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e22c8ff-c4e9-4ba0-b9ed-6b2cccc6d95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31ac5d5-e7f3-4927-8a34-69bc073046bb', 'volume_name': 'volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8281c-4ce8-4bca-94f1-77ce2845ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8281c-4ce8-4bca-94f1-77ce2845ae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632194bc-fcc6-4df4-b35a-5063ef691c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume a31ac5d5-e7f3-4927-8a34-69bc073046bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb', 'volume_size': 1} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (075bcb50-127a-4a6c-8877-a0f0f552ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6dce9f-b0ab-4df8-ac36-5fa603a58ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6dce9f-b0ab-4df8-ac36-5fa603a58ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863678821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9387575-8553-44fd-983a-718463bcb194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:12Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816bda3a-b35a-4570-b31e-1a5cba27bc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816bda3a-b35a-4570-b31e-1a5cba27bc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03c34a-19d0-460e-8126-b2fcc74eea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b03c34a-19d0-460e-8126-b2fcc74eea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9387575-8553-44fd-983a-718463bcb194', 'volume_name': 'volume-a9387575-8553-44fd-983a-718463bcb194', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db3e2c1-5a33-4c91-bea9-d7eb82f32ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db3e2c1-5a33-4c91-bea9-d7eb82f32ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2043e44d-8fba-4c64-ac3f-93d649021d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume a9387575-8553-44fd-983a-718463bcb194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9387575-8553-44fd-983a-718463bcb194', 'volume_size': 1} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:12 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a" returned: 0 in 1.527s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:12 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a Jul 10 08:05:12 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:12 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (496d1381-4ed9-4524-89bf-804d8d0337f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38bdf0-e13a-4421-ab59-3d137e0e2220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c637d7d7-5ab7-4a66-add5-37148901399a -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd" returned: 0 in 1.032s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:12 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd is being set with open permissions: ugo+rw Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38bdf0-e13a-4421-ab59-3d137e0e2220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-67743575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a315ddf8-f2e2-401a-9e1a-7c16323da4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:12Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd Jul 10 08:05:12 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dafd5b4-c7cf-43ac-8258-9045c31b5d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dafd5b4-c7cf-43ac-8258-9045c31b5d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c125f-cde4-424a-8086-947fa2627de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c125f-cde4-424a-8086-947fa2627de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a315ddf8-f2e2-401a-9e1a-7c16323da4a8', 'volume_name': 'volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59836daa-a46a-45bc-b89e-dc112dc44bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59836daa-a46a-45bc-b89e-dc112dc44bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4563887-0639-4927-890c-1fba8095218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume a315ddf8-f2e2-401a-9e1a-7c16323da4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8', 'volume_size': 1} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:12 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-abf5b399-452e-429d-a7dd-6b23e5311f4a" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-abf5b399-452e-429d-a7dd-6b23e5311f4a" released by "delete_volume" :: held 2.312s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['dd0a58eb-412f-4479-a60a-203c683eb030', '14f70e22-b548-4da5-8c06-3132b130aef8', '1430945f-6868-4340-bb74-5f344519cf7f', '05cc9eaa-2fc2-4575-8af8-6ebe22521271'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:13 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:13 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:13 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:13 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info Jul 10 08:05:13 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:13 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b15a9b53-7375-46d5-bc4a-40e679249a38 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-abf5b399-452e-429d-a7dd-6b23e5311f4a-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-4be10639-6f62-4351-b19c-efa160940c29-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-4be10639-6f62-4351-b19c-efa160940c29-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:13 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "cinder-quobyte-4be10639-6f62-4351-b19c-efa160940c29" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info is being set with open permissions: ugo+rw Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-4be10639-6f62-4351-b19c-efa160940c29" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:13 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info Jul 10 08:05:13 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d481702-5a29-4b66-b235-1156fce8d562]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:14 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 Jul 10 08:05:14 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:14 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.info" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.742s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.376s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500372649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb0d432-e875-43fc-883e-abb145491414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:10Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume aeb0d432-e875-43fc-883e-abb145491414 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:14 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:14 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 1073741824 Jul 10 08:05:14 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fbe3abaa-46c8-437b-a844-8443a9408935 tempest-ProjectReaderTests-1532914144 None] Create snapshot completed successfully Jul 10 08:05:14 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:14 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29 Jul 10 08:05:14 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:15 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-4be10639-6f62-4351-b19c-efa160940c29" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:15 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 1073741824" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-quobyte-4be10639-6f62-4351-b19c-efa160940c29" released by "delete_volume" :: held 1.655s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:15 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 Jul 10 08:05:15 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Created reservations ['ec6356f5-dc01-4ead-bbcb-19a8996e21bf', 'cf3d34d1-9396-4083-8a43-337310383610', '42ef36f8-22ce-4ee4-99eb-eecead96cd28', 'fa6e0d02-79d4-482d-9f26-965966c08dd3'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:15 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:15 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-20733707-f293-43e5-8298-c716d00762fd-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-20733707-f293-43e5-8298-c716d00762fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-20733707-f293-43e5-8298-c716d00762fd" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-20733707-f293-43e5-8298-c716d00762fd" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Deleting offline snapshot 20733707-f293-43e5-8298-c716d00762fd of volume c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] snapshot_file for this snap is: volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[972283d4-e319-4ee6-8f25-b9868df753be]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:16 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd Jul 10 08:05:16 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:16 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.484s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650597469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5acd6-d17f-4be2-9f50-5e2c886e9a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:11Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume 05a5acd6-d17f-4be2-9f50-5e2c886e9a08 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:16 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 1073741824 Jul 10 08:05:16 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4006ac-54b4-4651-85bd-0758298da71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb0d432-e875-43fc-883e-abb145491414', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecb9ed2-34fe-49dc-89f1-ddafe36e3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-aeb0d432-e875-43fc-883e-abb145491414 (aeb0d432-e875-43fc-883e-abb145491414): created successfully Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecb9ed2-34fe-49dc-89f1-ddafe36e3d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (27c2d81c-7e68-4a53-94df-1b7b5c710286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6369852b-58c0-4805-b3c4-9a55d6d5334c tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:16 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Deleted volume successfully. Jul 10 08:05:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-097ea7ac-46bf-4042-9c10-fa739ecf2c32 tempest-CreateVolumesFromSourceVolumeTest-2044549029 None] Lock "cinder-4be10639-6f62-4351-b19c-efa160940c29-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:17 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd" returned: 0 in 1.110s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c637d7d7-5ab7-4a66-add5-37148901399a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[02381b14-8ea1-46af-9965-be082a00630f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:17 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a Jul 10 08:05:17 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:17 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 1073741824" returned: 0 in 1.098s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:17 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 Jul 10 08:05:17 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:18 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a" returned: 0 in 0.987s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:18 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd Jul 10 08:05:18 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:18 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501061343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ac5d5-e7f3-4927-8a34-69bc073046bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:11Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume a31ac5d5-e7f3-4927-8a34-69bc073046bb {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:18 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bf1001-8d2f-47fa-a181-c0420104b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:18 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb 1073741824 Jul 10 08:05:18 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aec91f6-c175-40ab-9ad2-023709c48e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 (05a5acd6-d17f-4be2-9f50-5e2c886e9a08): created successfully Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aec91f6-c175-40ab-9ad2-023709c48e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (311c87ce-7693-47e9-9763-03a062c8e735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=210,cinder:SELECT=152,cinder:DELETE=14,cinder:INSERT=53 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:05:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06e63a71-ec10-44d7-9e7e-264786f4db35 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:19 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd" returned: 0 in 1.098s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:19 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd Jul 10 08:05:19 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:19 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb 1073741824" returned: 0 in 1.289s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=135,cinder:UPDATE=174,cinder:INSERT=52,cinder:DELETE=23 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:19 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb Jul 10 08:05:19 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Flow 'volume_create_manager' (311872a7-c528-4a2c-8216-5be183b1e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:20 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa37021-8a0a-4504-ae39-3001086c3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a.20733707-f293-43e5-8298-c716d00762fd" returned: 0 in 0.899s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-20733707-f293-43e5-8298-c716d00762fd" released by "_delete_snapshot" :: held 4.266s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" released by "delete_snapshot" :: held 4.316s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa37021-8a0a-4504-ae39-3001086c3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1620572927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909c0ea9-393a-4f38-bb34-b8aac84942f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f85a9e5bb41d4922c1f692e3e0016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:20Z,use_quota=True,user_id='88e7309f15494d6082dbf0e0a1fba190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4777d0c9-6b64-43c8-a424-9727b50f1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4777d0c9-6b64-43c8-a424-9727b50f1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5c0cf4-255c-4c91-b944-615574a25260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5c0cf4-255c-4c91-b944-615574a25260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909c0ea9-393a-4f38-bb34-b8aac84942f8', 'volume_name': 'volume-909c0ea9-393a-4f38-bb34-b8aac84942f8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0675517-cfa3-4624-9a6b-0ba65123e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0675517-cfa3-4624-9a6b-0ba65123e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab582a4c-0b3a-4656-99a1-b7ff40f828de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Volume 909c0ea9-393a-4f38-bb34-b8aac84942f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909c0ea9-393a-4f38-bb34-b8aac84942f8', 'volume_size': 1} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Created reservations ['3449410b-675d-40fd-813b-979e034334cf', 'b0f07626-0157-4085-9a2d-09db233d4a6c', '73d89bd9-4b3e-4047-995a-d8ecbec4a01c', '3a21ca73-7350-4c02-ab9f-07ead02cf326'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Delete snapshot completed successfully. Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0184d28b-8ec3-4969-9d56-32dbf006e455 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-20733707-f293-43e5-8298-c716d00762fd-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:20 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.582s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863678821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9387575-8553-44fd-983a-718463bcb194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:12Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume a9387575-8553-44fd-983a-718463bcb194 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:20 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 1073741824 Jul 10 08:05:20 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632194bc-fcc6-4df4-b35a-5063ef691c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc714a1d-07ce-4349-8d24-97d734d0a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb (a31ac5d5-e7f3-4927-8a34-69bc073046bb): created successfully Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc714a1d-07ce-4349-8d24-97d734d0a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (3aab94b4-7a4d-4612-92cc-faeb59da681b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a341fac5-498c-4437-bc46-f4b767283392 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-c637d7d7-5ab7-4a66-add5-37148901399a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-c637d7d7-5ab7-4a66-add5-37148901399a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:21 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 1073741824" returned: 0 in 0.958s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c436c09-9e7d-4c31-a2f9-8c8da596e93c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:21 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 Jul 10 08:05:21 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:21 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a Jul 10 08:05:21 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:22 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.049s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-67743575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a315ddf8-f2e2-401a-9e1a-7c16323da4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6419a0a934fa6ac32155eeb26b03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:12Z,use_quota=True,user_id='d7e804f900c74a1ca54435c6d833b352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Creating volume a315ddf8-f2e2-401a-9e1a-7c16323da4a8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:22 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2043e44d-8fba-4c64-ac3f-93d649021d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9387575-8553-44fd-983a-718463bcb194', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:22 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 1073741824 Jul 10 08:05:22 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:22 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3420812b-5ad8-4629-b999-eaa61452bfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-a9387575-8553-44fd-983a-718463bcb194 (a9387575-8553-44fd-983a-718463bcb194): created successfully Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3420812b-5ad8-4629-b999-eaa61452bfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:22 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a Jul 10 08:05:22 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (075bcb50-127a-4a6c-8877-a0f0f552ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6a532548-9380-4908-b8d1-2c238b13a912 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:23 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c637d7d7-5ab7-4a66-add5-37148901399a" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-c637d7d7-5ab7-4a66-add5-37148901399a" released by "delete_volume" :: held 1.714s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Created reservations ['bb5fbf1d-344c-41cc-9ddc-77df14819841', '61fb1ea9-2f76-42a2-809f-5887cb9591a3', 'bfc21e7f-6067-48cd-9b06-1e8d0bfef045', 'c4c636e7-a3a4-4d8a-95c0-5ef52dfabfdc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:23 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:23 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 1073741824" returned: 0 in 1.031s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:23 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:23 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 Jul 10 08:05:23 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:24 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Deleted volume successfully. Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4aebb6c3-0247-46f6-94f8-dbd68d9fd106 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-c637d7d7-5ab7-4a66-add5-37148901399a-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:24 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.840s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1620572927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909c0ea9-393a-4f38-bb34-b8aac84942f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f85a9e5bb41d4922c1f692e3e0016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:20Z,use_quota=True,user_id='88e7309f15494d6082dbf0e0a1fba190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Creating volume 909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:24 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:24 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 1073741824 Jul 10 08:05:24 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (ed3e84bf-5c85-4f4d-8143-de0a886480a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bf2b61-0415-4bff-9c35-f312851e90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4563887-0639-4927-890c-1fba8095218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f088b-22e6-40c1-9ffe-aed9715d595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bf2b61-0415-4bff-9c35-f312851e90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006269235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2ce76c-d606-4506-ab27-1941248f352e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:24Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b099738-ebd5-4043-8309-0c6fc069e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b099738-ebd5-4043-8309-0c6fc069e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d060e4a6-dc69-4557-81dc-fb60c7f24e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d060e4a6-dc69-4557-81dc-fb60c7f24e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2ce76c-d606-4506-ab27-1941248f352e', 'volume_name': 'volume-de2ce76c-d606-4506-ab27-1941248f352e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba54d44a-ccdd-4a69-8425-edff81cea377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba54d44a-ccdd-4a69-8425-edff81cea377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf83079-af1e-40c6-bd8c-3328ce1b9396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Volume de2ce76c-d606-4506-ab27-1941248f352e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2ce76c-d606-4506-ab27-1941248f352e', 'volume_size': 1} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Volume volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 (a315ddf8-f2e2-401a-9e1a-7c16323da4a8): created successfully Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31f088b-22e6-40c1-9ffe-aed9715d595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Flow 'volume_create_manager' (496d1381-4ed9-4524-89bf-804d8d0337f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-43b75b39-9da3-47a3-8480-5060920fa115 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created volume successfully. Jul 10 08:05:25 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 1073741824" returned: 0 in 0.937s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:25 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:25 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-a315ddf8-f2e2-401a-9e1a-7c16323da4a8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a315ddf8-f2e2-401a-9e1a-7c16323da4a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcdb443-e22a-4e3d-b1df-14231c02bd33]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:25 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 Jul 10 08:05:25 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:26 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006269235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2ce76c-d606-4506-ab27-1941248f352e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:24Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Creating volume de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:26 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e 1073741824 Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab582a4c-0b3a-4656-99a1-b7ff40f828de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909c0ea9-393a-4f38-bb34-b8aac84942f8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:26 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c968384f-358d-4073-9123-2e6debc76eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Volume volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 (909c0ea9-393a-4f38-bb34-b8aac84942f8): created successfully Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c968384f-358d-4073-9123-2e6debc76eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Flow 'volume_create_manager' (311872a7-c528-4a2c-8216-5be183b1e371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9911f753-7f96-4152-bbf0-6beb6417db0a tempest-VolumeDependencyTests-748601961 None] Created volume successfully. Jul 10 08:05:26 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:26 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8 Jul 10 08:05:26 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:27 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e 1073741824" returned: 0 in 1.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:27 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e Jul 10 08:05:27 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:27 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a315ddf8-f2e2-401a-9e1a-7c16323da4a8" released by "delete_volume" :: held 1.668s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['85336117-9fda-49f0-b9a8-ee89f355ad99', '19d19a47-b293-4e9e-99f1-fa5e4e87b951', '7a19ad4d-3047-44ac-8e9b-807c7a05c551', 'e0214991-f871-4b1b-bbf3-0742a61efd9a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:27 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:27 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:27 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Creating offline snapshot 3e9d7325-b1c8-4278-9b9d-7772573a807c of volume 909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf83079-af1e-40c6-bd8c-3328ce1b9396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2ce76c-d606-4506-ab27-1941248f352e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076c8da1-bf85-46f6-b2f4-4320cc26f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0db8f-c12d-4051-b17c-d8d949fcba44]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Volume volume-de2ce76c-d606-4506-ab27-1941248f352e (de2ce76c-d606-4506-ab27-1941248f352e): created successfully Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076c8da1-bf85-46f6-b2f4-4320cc26f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (ed3e84bf-5c85-4f4d-8143-de0a886480a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-976048a0-2e4d-42b7-835a-936d96770735 tempest-ProjectReaderTests-1532914144 None] Created volume successfully. Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-a9387575-8553-44fd-983a-718463bcb194-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:28 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a9387575-8553-44fd-983a-718463bcb194-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:28 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-a9387575-8553-44fd-983a-718463bcb194" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a9387575-8553-44fd-983a-718463bcb194" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff890eef-31eb-4420-9d59-da4694fec866]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:28 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 Jul 10 08:05:28 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:28 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a5d5d1a6-1430-43eb-a881-f32f37c8eff9 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a315ddf8-f2e2-401a-9e1a-7c16323da4a8-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:28 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 1.004s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:28 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c 1G Jul 10 08:05:28 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:29 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:29 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194 Jul 10 08:05:29 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:29 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c 1G" returned: 0 in 0.908s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:29 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:29 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:29 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a9387575-8553-44fd-983a-718463bcb194" returned: 0 in 0.722s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a9387575-8553-44fd-983a-718463bcb194" released by "delete_volume" :: held 1.788s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['3c214268-fcaa-4136-b304-ecc9f662bc0c', '442a0f33-8e20-4435-8097-a99e34177850', '2c3367f3-6bdb-4037-99a2-2a21008101ea', 'c6a8da08-d824-4137-aff2-0a8ae53af631'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:30 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:30 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-a31ac5d5-e7f3-4927-8a34-69bc073046bb-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a31ac5d5-e7f3-4927-8a34-69bc073046bb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-a31ac5d5-e7f3-4927-8a34-69bc073046bb" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a31ac5d5-e7f3-4927-8a34-69bc073046bb" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564509f-6376-4706-94f1-d11f34182dfb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:30 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb Jul 10 08:05:30 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:30 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:30 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c is being set with open permissions: ugo+rw Jul 10 08:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:30 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:30 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:31 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.868s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4a5bc850-36c8-41b3-8b36-1d33f98e1aa1 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a9387575-8553-44fd-983a-718463bcb194-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:31 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:31 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb Jul 10 08:05:31 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:31 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 0.810s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:31 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info Jul 10 08:05:31 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:32 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a31ac5d5-e7f3-4927-8a34-69bc073046bb" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-a31ac5d5-e7f3-4927-8a34-69bc073046bb" released by "delete_volume" :: held 1.619s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['33acaac2-5bf1-4ae1-ae9b-b15df39a2a04', 'f2c21583-d11b-4b21-acc6-5f375eb0ca92', '3537aead-7e7e-4d32-859f-969666ec459b', '3553ef1b-e43e-4321-b1c3-f8c18e278cd4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:32 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:32 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info is being set with open permissions: ugo+rw Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:32 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:32 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:32 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info Jul 10 08:05:32 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-05a5acd6-d17f-4be2-9f50-5e2c886e9a08-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-05a5acd6-d17f-4be2-9f50-5e2c886e9a08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[073cc44c-5696-4f13-a7d1-5dd32a0df985]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:33 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:33 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 Jul 10 08:05:33 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.info" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.173s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:33 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.339s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Creating offline snapshot 7e2ff844-cc43-464b-a30c-322ac7e80825 of volume de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:05:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-48721d8f-6fef-4888-85d5-99dd81e83624 tempest-VolumeDependencyTests-748601961 None] Create snapshot completed successfully Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8f5860fa-86de-4cf7-b0ee-322c89bdf199 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-a31ac5d5-e7f3-4927-8a34-69bc073046bb-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90d489-541a-40b8-b22a-a9c10d46d48e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:33 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e Jul 10 08:05:33 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:33 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" returned: 0 in 0.898s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:33 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08 Jul 10 08:05:33 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:34 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:34 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 1G Jul 10 08:05:34 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Flow 'volume_create_manager' (fda1d09b-d6d4-4d16-b40c-2450c64a0906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3de5f-2fd6-4bb6-a91c-ed3e839fa4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3de5f-2fd6-4bb6-a91c-ed3e839fa4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1814362200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f47921d-a7ba-4ff6-80b8-2415b4af6b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800f85a9e5bb41d4922c1f692e3e0016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e9d7325-b1c8-4278-9b9d-7772573a807c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:34Z,use_quota=True,user_id='88e7309f15494d6082dbf0e0a1fba190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa13de2-a51e-4c8c-995d-216213abfab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa13de2-a51e-4c8c-995d-216213abfab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b0683-4fb9-4e54-9098-a7d5de2e0300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b0683-4fb9-4e54-9098-a7d5de2e0300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f47921d-a7ba-4ff6-80b8-2415b4af6b1a', 'volume_name': 'volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a', 'volume_size': 1, 'snapshot_id': '3e9d7325-b1c8-4278-9b9d-7772573a807c'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3feff859-9242-4f7b-88c6-f1b9f1923244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3feff859-9242-4f7b-88c6-f1b9f1923244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7d9fb9-bbbb-4747-8200-e9e626b50037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Volume 9f47921d-a7ba-4ff6-80b8-2415b4af6b1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a', 'volume_size': 1, 'snapshot_id': '3e9d7325-b1c8-4278-9b9d-7772573a807c'} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:34 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" returned: 0 in 0.761s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-05a5acd6-d17f-4be2-9f50-5e2c886e9a08" released by "delete_volume" :: held 1.716s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['7eb12578-3ce8-4606-b2f6-44eb28c1a07a', 'f4b27599-faee-40b0-9169-bd1e36289ad0', 'd22bea83-2f6d-4fea-b44d-7ba9d12f6257', 'd2d3fa01-9aee-48ab-89da-0a228dc6e028'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:34 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:34 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-aeb0d432-e875-43fc-883e-abb145491414-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-aeb0d432-e875-43fc-883e-abb145491414-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:35 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 1G" returned: 0 in 1.063s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2ce76c-d606-4506-ab27-1941248f352e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:35 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2ce76c-d606-4506-ab27-1941248f352e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 Jul 10 08:05:35 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-aeb0d432-e875-43fc-883e-abb145491414" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-aeb0d432-e875-43fc-883e-abb145491414" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b431a42-d8c4-451e-945c-0528ab758115]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:35 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 Jul 10 08:05:35 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:35 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-54e4b56f-1fe5-4f85-ae1c-df9aa5d070cd tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-05a5acd6-d17f-4be2-9f50-5e2c886e9a08-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:35 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2ce76c-d606-4506-ab27-1941248f352e -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 is being set with open permissions: ugo+rw Jul 10 08:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:35 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 Jul 10 08:05:35 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:36 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414" returned: 0 in 1.105s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:36 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414 Jul 10 08:05:36 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:36 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:36 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:36 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825" returned: 0 in 0.974s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:37 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info Jul 10 08:05:37 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:37 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:05:37 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-aeb0d432-e875-43fc-883e-abb145491414" returned: 0 in 1.111s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-aeb0d432-e875-43fc-883e-abb145491414" released by "delete_volume" :: held 2.276s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['a9a6fdd7-2e85-489b-9666-faab63ec6ee9', 'b96c48d2-e277-4413-981e-c816e72a4ce9', '627fa3b9-9d07-4be7-90eb-aac9609ee9ec', '2afd7de3-e8d6-4d8a-a59c-cfef9143ae6f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:37 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:37 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:37 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:37 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info is being set with open permissions: ugo+rw Jul 10 08:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:37 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info Jul 10 08:05:37 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-1f881437-6f31-4924-b318-2f7cecf9a7e4-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:38 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-1f881437-6f31-4924-b318-2f7cecf9a7e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-1f881437-6f31-4924-b318-2f7cecf9a7e4" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-31cc5815-f374-4df9-ac04-15a517ebd692 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-aeb0d432-e875-43fc-883e-abb145491414-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-1f881437-6f31-4924-b318-2f7cecf9a7e4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleting offline snapshot 1f881437-6f31-4924-b318-2f7cecf9a7e4 of volume 8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] snapshot_file for this snap is: volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:05:38 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.info" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.642s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f7bcd-4995-4f9f-8963-530b854fa694]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.420s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Creating volume 9f47921d-a7ba-4ff6-80b8-2415b4af6b1a from snapshot 3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c8c41537-24ad-41d7-a4e9-9dbb268befb2 tempest-ProjectReaderTests-1532914144 None] Create snapshot completed successfully Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] snapshot: 3e9d7325-b1c8-4278-9b9d-7772573a807c, volume: 9f47921d-a7ba-4ff6-80b8-2415b4af6b1a, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[791956cc-82ab-4bd8-94b4-e3097277a80e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:38 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 Jul 10 08:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:38 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:39 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:39 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-7e2ff844-cc43-464b-a30c-322ac7e80825-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-7e2ff844-cc43-464b-a30c-322ac7e80825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-7e2ff844-cc43-464b-a30c-322ac7e80825" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-7e2ff844-cc43-464b-a30c-322ac7e80825" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Deleting offline snapshot 7e2ff844-cc43-464b-a30c-322ac7e80825 of volume de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] snapshot_file for this snap is: volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d72d74f-0440-4eeb-8e9c-34c87e69d5d9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:39 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 Jul 10 08:05:39 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:39 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4" returned: 0 in 1.117s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8630d994-8aea-4444-80ec-e889a505c89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9beed58-629d-4489-bb3b-9f8be8f60711]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:39 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 1.068s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909c0ea9-393a-4f38-bb34-b8aac84942f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a5f09-8d2e-43f2-8a73-f0814458ff2d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:39 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b Jul 10 08:05:39 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:40 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:40 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:40 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de2ce76c-d606-4506-ab27-1941248f352e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a44245-78e2-4ce8-bef5-95a11000dd4f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:40 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e Jul 10 08:05:40 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:40 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b" returned: 0 in 1.030s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:40 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 08:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:40 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 Jul 10 08:05:40 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:40 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a Jul 10 08:05:40 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:41 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e" returned: 0 in 1.038s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:41 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 Jul 10 08:05:41 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:41 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4" returned: 0 in 0.982s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:41 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4 Jul 10 08:05:41 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:43 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:43 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825" returned: 0 in 1.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b.1f881437-6f31-4924-b318-2f7cecf9a7e4" returned: 0 in 1.481s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:43 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825 Jul 10 08:05:43 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-1f881437-6f31-4924-b318-2f7cecf9a7e4" released by "_delete_snapshot" :: held 4.886s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" released by "delete_snapshot" :: held 4.942s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['111284eb-18b7-45a1-8aa6-1effbb2710b5', 'e2a0699e-1299-42ac-a852-26ec2d08ad9f', 'ab4eb77b-0fce-4aee-af1e-df445ca91f1c', '56781246-6b84-4b21-80c1-13d0af337a59'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Delete snapshot completed successfully. Jul 10 08:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5289129-7dd1-4719-a43b-dbc71c337ede tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-1f881437-6f31-4924-b318-2f7cecf9a7e4-delete_snapshot" released by "delete_snapshot" :: held 5.286s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-8630d994-8aea-4444-80ec-e889a505c89b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-8630d994-8aea-4444-80ec-e889a505c89b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[536074e0-5c87-4688-8a34-9b17c11992bc]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:44 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b Jul 10 08:05:44 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:45 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e.7e2ff844-cc43-464b-a30c-322ac7e80825" returned: 0 in 1.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-7e2ff844-cc43-464b-a30c-322ac7e80825" released by "_delete_snapshot" :: held 5.737s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" released by "delete_snapshot" :: held 5.789s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Created reservations ['745415b6-4066-46ab-ab64-c93f6e420d03', 'f72cb4b0-215a-4441-a9b7-7a680cf7f91b', '2c34d7ce-38ed-4ebf-ac55-c862531a4015', '6acefb72-eb30-49de-8fd6-8f10e115274b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Delete snapshot completed successfully. Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-85971676-0b89-48ab-ab3b-057cef113438 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-7e2ff844-cc43-464b-a30c-322ac7e80825-delete_snapshot" released by "delete_snapshot" :: held 6.127s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:45 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b" returned: 0 in 1.373s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:45 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b Jul 10 08:05:45 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-de2ce76c-d606-4506-ab27-1941248f352e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-de2ce76c-d606-4506-ab27-1941248f352e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3003f613-7741-4653-919c-7e3f87476a65]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:46 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e Jul 10 08:05:46 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:47 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-8630d994-8aea-4444-80ec-e889a505c89b" returned: 0 in 1.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-quobyte-8630d994-8aea-4444-80ec-e889a505c89b" released by "delete_volume" :: held 3.191s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:47 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" returned: 0 in 6.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Created reservations ['8238692a-7144-4e76-9a25-a1f4670a90c2', '7c053173-8a87-4259-949b-81cd18b2f2c6', '2816e86f-c60a-46b4-9b86-4f5d7c50d164', '6e398144-2cf5-4d1a-a247-86f41a570ccf'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9330f05a-b588-4536-b305-3496bdf19da3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:47 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:47 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:47 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:47 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:48 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e" returned: 0 in 1.593s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:48 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e Jul 10 08:05:48 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:48 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.862s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Deleted volume successfully. Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f2386b-cd90-42ac-b55c-1c8fbc112eb7 tempest-CreateVolumesFromSnapshotTest-1183536300 None] Lock "cinder-8630d994-8aea-4444-80ec-e889a505c89b-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:48 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 1.333s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:05:48 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Converted 1024.00 MB image at 153.21 MB/s Jul 10 08:05:48 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a is being set with open permissions: ugo+rw Jul 10 08:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:49 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a Jul 10 08:05:49 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:49 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-de2ce76c-d606-4506-ab27-1941248f352e" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-de2ce76c-d606-4506-ab27-1941248f352e" released by "delete_volume" :: held 2.692s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Created reservations ['e663a2b3-78dc-4519-9f0e-49e9dda2d95a', '648a6f7c-e4d3-41a1-84c9-e5e74550ca00', 'fe2a71c1-6097-45cb-a0d8-a864a282f452', 'ad7becab-41b8-44b4-a696-9ae69bec1930'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:49 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:49 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:50 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" returned: 0 in 1.070s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" released by "_copy_volume_from_snapshot" :: held 11.257s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" released by "_create_volume_from_snapshot" :: held 11.315s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.371s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7d9fb9-bbbb-4747-8200-e9e626b50037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a', 'volume_size': 1, 'snapshot_id': '3e9d7325-b1c8-4278-9b9d-7772573a807c'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b33a1a-e0e6-45b5-8664-64e40e31514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Volume volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a (9f47921d-a7ba-4ff6-80b8-2415b4af6b1a): created successfully Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b33a1a-e0e6-45b5-8664-64e40e31514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Flow 'volume_create_manager' (fda1d09b-d6d4-4d16-b40c-2450c64a0906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-99cb3802-4be9-45c6-9b4e-0eb75a948ddf tempest-VolumeDependencyTests-748601961 None] Created volume successfully. Jul 10 08:05:50 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 1.019s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Deleted volume successfully. Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7ac5937d-1ecd-4212-a923-c7f24d59e096 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-de2ce76c-d606-4506-ab27-1941248f352e-delete_volume" released by "delete_volume" :: held 4.105s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (112e24a8-8f4c-472b-bbb2-f3dccfac1559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214e6efa-af8e-4422-9a37-612b8894842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214e6efa-af8e-4422-9a37-612b8894842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303496945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a30c02-09b8-4e4d-be12-caf8c7c65f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:50Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c98460-624a-4dc9-bc9f-48ae2c41aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c98460-624a-4dc9-bc9f-48ae2c41aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d840743-9263-46d7-892e-fd0f76a56dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d840743-9263-46d7-892e-fd0f76a56dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a30c02-09b8-4e4d-be12-caf8c7c65f56', 'volume_name': 'volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44067084-d834-4248-b06f-479aaf3a2f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44067084-d834-4248-b06f-479aaf3a2f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983c03b4-e8cf-43ac-85c3-0f5f2ecfe869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Volume 18a30c02-09b8-4e4d-be12-caf8c7c65f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56', 'volume_size': 1} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303496945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a30c02-09b8-4e4d-be12-caf8c7c65f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:50Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Creating volume 18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:50 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 1073741824 Jul 10 08:05:50 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-3e9d7325-b1c8-4278-9b9d-7772573a807c-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-3e9d7325-b1c8-4278-9b9d-7772573a807c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Deleting offline snapshot 3e9d7325-b1c8-4278-9b9d-7772573a807c of volume 909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:05:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] snapshot_file for this snap is: volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:05:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e83eec-7021-4071-aa2d-9cf4bd919f7d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:51 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:51 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:51 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 1073741824" returned: 0 in 1.263s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:51 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 Jul 10 08:05:51 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:52 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 1.294s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909c0ea9-393a-4f38-bb34-b8aac84942f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d7e571-acd0-4bed-a595-877a083912e4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:52 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:52 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:52 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56" returned: 0 in 1.014s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983c03b4-e8cf-43ac-85c3-0f5f2ecfe869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d383e216-17a1-4f03-884b-d0c5ac1d652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Volume volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 (18a30c02-09b8-4e4d-be12-caf8c7c65f56): created successfully Jul 10 08:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d383e216-17a1-4f03-884b-d0c5ac1d652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (112e24a8-8f4c-472b-bbb2-f3dccfac1559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b758da3c-c000-4e23-aafd-247b5c6b8daf tempest-ProjectReaderTests-1532914144 None] Created volume successfully. Jul 10 08:05:53 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 1.036s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:53 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:53 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Creating offline snapshot d9962fa6-1705-4c35-83d8-bac69be42bd1 of volume 18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ad810-d6a7-40cf-8a93-85bac0aff84b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:54 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 Jul 10 08:05:54 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:54 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:54 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c Jul 10 08:05:54 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:55 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8.3e9d7325-b1c8-4278-9b9d-7772573a807c" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:55 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56" returned: 0 in 1.043s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-3e9d7325-b1c8-4278-9b9d-7772573a807c" released by "_delete_snapshot" :: held 4.168s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" released by "delete_snapshot" :: held 4.212s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:55 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 1G Jul 10 08:05:55 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Created reservations ['f6dae668-8cfc-43e5-8947-2c992d13a686', 'ea79b4fe-e6ff-4990-aa59-39c70d1eb53e', '2b8524a9-442d-4956-807b-cc71b7288f60', 'eb664075-91d1-4e05-9f9e-598c93c834dc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Delete snapshot completed successfully. Jul 10 08:05:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-87b77d9b-1381-4bb6-aeba-2bd72298e8e9 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-3e9d7325-b1c8-4278-9b9d-7772573a807c-delete_snapshot" released by "delete_snapshot" :: held 4.452s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:56 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 1G" returned: 0 in 1.188s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-909c0ea9-393a-4f38-bb34-b8aac84942f8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:56 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 Jul 10 08:05:56 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "cinder-909c0ea9-393a-4f38-bb34-b8aac84942f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1baba-7235-49f2-8c6e-a3f9bebf2811]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Flow 'volume_create_manager' (e2ea5f84-4d42-4392-88fa-0a3960696891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04a4b54-6753-4f63-b1c3-7f54b2b2026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04a4b54-6753-4f63-b1c3-7f54b2b2026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2091533911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c67cf34-d308-4fcc-b0fa-b351305d2b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c59a921eb234026829dc15fd52b2ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:57Z,use_quota=True,user_id='68f1cbe8f26d47fc8fdebb6cf5a7b94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93e85b4-8d10-4dc1-aa95-4baaeb35d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93e85b4-8d10-4dc1-aa95-4baaeb35d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:56 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba8a0e9-e57e-4382-9e06-404fc7832998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:56 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba8a0e9-e57e-4382-9e06-404fc7832998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c67cf34-d308-4fcc-b0fa-b351305d2b31', 'volume_name': 'volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25211eb9-1d1a-49d5-825d-c4d062774a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25211eb9-1d1a-49d5-825d-c4d062774a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ba1c3-5095-480b-9b66-c3680dfbec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:05:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Volume 1c67cf34-d308-4fcc-b0fa-b351305d2b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31', 'volume_size': 1} Jul 10 08:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:57 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1" returned: 0 in 0.749s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:57 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 is being set with open permissions: ugo+rw Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:57 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 Jul 10 08:05:57 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:57 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:57 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8 Jul 10 08:05:57 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:57 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:57 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info Jul 10 08:05:57 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:58 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-909c0ea9-393a-4f38-bb34-b8aac84942f8" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-909c0ea9-393a-4f38-bb34-b8aac84942f8" released by "delete_volume" :: held 1.640s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Created reservations ['97d63c98-0dd7-49fb-bca0-a30d3c4b7938', '29480575-5881-4e41-82b3-d9262aa89a64', 'b7e5108b-a270-435f-a031-dbe1b867557c', '1e35bf96-17a9-4755-9ff5-ab75c6ed5143'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:58 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:05:58 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:58 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:58 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info is being set with open permissions: ugo+rw Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:58 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info Jul 10 08:05:58 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b87ca-1bdc-419e-8b80-84e3fd1cb665]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:05:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:58 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a Jul 10 08:05:58 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:59 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:05:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Deleted volume successfully. Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92f62895-14a0-4dbd-84d8-c501f78818bd tempest-VolumeDependencyTests-748601961 None] Lock "cinder-909c0ea9-393a-4f38-bb34-b8aac84942f8-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:05:59 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.info" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.209s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.565s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2091533911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c67cf34-d308-4fcc-b0fa-b351305d2b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c59a921eb234026829dc15fd52b2ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:05:57Z,use_quota=True,user_id='68f1cbe8f26d47fc8fdebb6cf5a7b94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Creating volume 1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:05:59 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:59 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 1073741824 Jul 10 08:05:59 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:05:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-81f0dc95-c217-41b6-8dd8-50cbacbffb79 tempest-ProjectReaderTests-1532914144 None] Create snapshot completed successfully Jul 10 08:05:59 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" returned: 0 in 0.881s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:05:59 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a Jul 10 08:05:59 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:00 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 1073741824" returned: 0 in 0.878s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:00 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:00 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-d9962fa6-1705-4c35-83d8-bac69be42bd1-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-d9962fa6-1705-4c35-83d8-bac69be42bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:00 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-d9962fa6-1705-4c35-83d8-bac69be42bd1" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-quobyte-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a" released by "delete_volume" :: held 1.646s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-d9962fa6-1705-4c35-83d8-bac69be42bd1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Deleting offline snapshot d9962fa6-1705-4c35-83d8-bac69be42bd1 of volume 18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] snapshot_file for this snap is: volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[11256063-e861-412d-929f-7f961a94ebaf]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Created reservations ['3785b3f7-0d17-49ef-9640-b6994c1f408f', 'd7c99e9c-2df5-470b-bc62-4f8627336a90', 'a7ff3bdc-56bd-4007-80c4-130515a3ea15', '09405f7a-cab7-46af-8f85-fa42edc7c62d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:00 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 Jul 10 08:06:00 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:00 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:00 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:01 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ba1c3-5095-480b-9b66-c3680dfbec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf00bf9-157e-4109-aaea-de4c2c8f18ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Volume volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 (1c67cf34-d308-4fcc-b0fa-b351305d2b31): created successfully Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf00bf9-157e-4109-aaea-de4c2c8f18ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Flow 'volume_create_manager' (e2ea5f84-4d42-4392-88fa-0a3960696891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eeee178d-c6c6-4995-8053-172ed74800a6 tempest-SnapshotDependencyTests-349831953 None] Created volume successfully. Jul 10 08:06:01 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Deleted volume successfully. Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-107546ba-921e-4f1b-be0d-4a047fdb4fc1 tempest-VolumeDependencyTests-748601961 None] Lock "cinder-9f47921d-a7ba-4ff6-80b8-2415b4af6b1a-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:01 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1" returned: 0 in 0.911s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c858549c-fc28-4008-8f0a-3a0e7803771d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:01 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 Jul 10 08:06:01 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Creating offline snapshot 55761fe6-7af2-4f76-b68a-be42ba6ea892 of volume 1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc619067-1827-4b36-aa55-cf8661809d73]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:02 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:02 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:02 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56" returned: 0 in 0.920s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:02 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 Jul 10 08:06:02 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:02 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:02 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 1G Jul 10 08:06:02 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:03 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1" returned: 0 in 0.831s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:03 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1 Jul 10 08:06:03 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:03 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 1G" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:03 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:03 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:03 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56.d9962fa6-1705-4c35-83d8-bac69be42bd1" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-d9962fa6-1705-4c35-83d8-bac69be42bd1" released by "_delete_snapshot" :: held 3.507s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" released by "delete_snapshot" :: held 3.551s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Created reservations ['bada251f-af61-49e5-8f06-821c32c5a584', 'a6211662-e355-4eeb-abdb-badd92fe354b', '050ab448-05bc-4573-be68-1bc11bdf8aef', '64d17e9a-6528-4c18-85f5-580f5deac4ec'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Delete snapshot completed successfully. Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d0196255-6229-4b1f-9fa8-f736f8bf243b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-d9962fa6-1705-4c35-83d8-bac69be42bd1-delete_snapshot" released by "delete_snapshot" :: held 3.714s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:04 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:04 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 is being set with open permissions: ugo+rw Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:04 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:04 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-18a30c02-09b8-4e4d-be12-caf8c7c65f56-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-18a30c02-09b8-4e4d-be12-caf8c7c65f56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b2d1d-88d6-43a5-bd97-7270d1330e43]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:04 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 Jul 10 08:06:04 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:05 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:05 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info Jul 10 08:06:05 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:05 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:05 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56 Jul 10 08:06:05 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:05 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:05 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info is being set with open permissions: ugo+rw Jul 10 08:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:06 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info Jul 10 08:06:06 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:06 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-18a30c02-09b8-4e4d-be12-caf8c7c65f56" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-18a30c02-09b8-4e4d-be12-caf8c7c65f56" released by "delete_volume" :: held 1.644s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Created reservations ['6c0c625f-5f58-4c79-b68b-95a1ebd4fccb', '2bb3c1b3-743e-4176-8f6c-26d15551f772', '8b2f8784-546e-44e1-ad39-abd78cf2af4e', 'ff3b4765-88ef-4a05-9b39-2ff63f6ac29a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:06 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:06 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:06 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.info" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-60b7d19c-5c47-479e-98b7-38813c1c4c5f tempest-SnapshotDependencyTests-349831953 None] Create snapshot completed successfully Jul 10 08:06:07 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Deleted volume successfully. Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89daf4a6-f9c2-47bb-8fe4-c10f9f036352 tempest-ProjectReaderTests-1532914144 None] Lock "cinder-18a30c02-09b8-4e4d-be12-caf8c7c65f56-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (44715a8e-e5d2-4fff-889c-abb3673d324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dc3eac-8d44-4cfa-89ed-079f92c66b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dc3eac-8d44-4cfa-89ed-079f92c66b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1853122460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0c7533-df9f-4a35-b038-0074cfb392b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:07Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15e4598-5e84-4b33-be19-8b456f40596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15e4598-5e84-4b33-be19-8b456f40596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a06200-bd4b-43ab-883e-63d44e27366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a06200-bd4b-43ab-883e-63d44e27366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0c7533-df9f-4a35-b038-0074cfb392b9', 'volume_name': 'volume-6c0c7533-df9f-4a35-b038-0074cfb392b9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba7e7cf-ada1-4e31-81dd-6197bd803301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba7e7cf-ada1-4e31-81dd-6197bd803301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5ab7e9-637f-4fc8-8625-16e73fad0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Volume 6c0c7533-df9f-4a35-b038-0074cfb392b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0c7533-df9f-4a35-b038-0074cfb392b9', 'volume_size': 1} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1853122460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0c7533-df9f-4a35-b038-0074cfb392b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:07Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Creating volume 6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:07 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 1073741824 Jul 10 08:06:07 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Flow 'volume_create_manager' (107352df-a9e3-4ec2-a34f-0f424b2e1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746083f-55ad-44e7-ba95-84de2f756605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746083f-55ad-44e7-ba95-84de2f756605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9614ee-481e-431c-a81d-1809d94fc9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c59a921eb234026829dc15fd52b2ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55761fe6-7af2-4f76-b68a-be42ba6ea892,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:08Z,use_quota=True,user_id='68f1cbe8f26d47fc8fdebb6cf5a7b94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd140a-d712-4b18-aaf1-57239d4025cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd140a-d712-4b18-aaf1-57239d4025cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8203e462-52d0-43c5-8402-c7ca7b6bfc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8203e462-52d0-43c5-8402-c7ca7b6bfc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb9614ee-481e-431c-a81d-1809d94fc9dc', 'volume_name': 'volume-bb9614ee-481e-431c-a81d-1809d94fc9dc', 'volume_size': 1, 'snapshot_id': '55761fe6-7af2-4f76-b68a-be42ba6ea892'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55507361-4d29-4a38-bc8f-c4976a771981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55507361-4d29-4a38-bc8f-c4976a771981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4afd7f-5853-48a3-89ec-3ab35917aa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Volume bb9614ee-481e-431c-a81d-1809d94fc9dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb9614ee-481e-431c-a81d-1809d94fc9dc', 'volume_size': 1, 'snapshot_id': '55761fe6-7af2-4f76-b68a-be42ba6ea892'} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:08 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 1073741824" returned: 0 in 0.899s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:08 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 Jul 10 08:06:08 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:09 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.056s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892-bb9614ee-481e-431c-a81d-1809d94fc9dc" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892-bb9614ee-481e-431c-a81d-1809d94fc9dc" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Creating volume bb9614ee-481e-431c-a81d-1809d94fc9dc from snapshot 55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5ab7e9-637f-4fc8-8625-16e73fad0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0c7533-df9f-4a35-b038-0074cfb392b9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62892699-810d-4f78-95db-a4e86ada9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] snapshot: 55761fe6-7af2-4f76-b68a-be42ba6ea892, volume: bb9614ee-481e-431c-a81d-1809d94fc9dc, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 08:06:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Volume volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 (6c0c7533-df9f-4a35-b038-0074cfb392b9): created successfully Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62892699-810d-4f78-95db-a4e86ada9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (44715a8e-e5d2-4fff-889c-abb3673d324b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bae7a2cb-36ac-4fe0-b1d6-7b998b4183c8 tempest-ProjectReaderTests-1532914144 None] Created volume successfully. Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e323b6-8fe6-4ba1-8500-522ac72c0680]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:09 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:09 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (e7b19b30-2a3e-461d-9913-93aaa3e90d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9689c502-fca7-42c5-9e6a-912351048994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9689c502-fca7-42c5-9e6a-912351048994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421721475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:10Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac97ca-5ae4-4fc1-a1cb-70bca515f48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac97ca-5ae4-4fc1-a1cb-70bca515f48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752385f0-ffbb-4fb8-8b96-a6aaf154f0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752385f0-ffbb-4fb8-8b96-a6aaf154f0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd', 'volume_name': 'volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb39517-0fe3-4100-b7d6-d6390d1f6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb39517-0fe3-4100-b7d6-d6390d1f6f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13183c15-1808-479f-87d7-ed66ef781df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Volume fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd', 'volume_size': 1} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:10 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.804s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e123a-99af-4d18-9394-29c542d624a6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:10 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:10 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:10 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Path /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 08:06:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:10 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc Jul 10 08:06:10 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:15 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc" returned: 0 in 4.582s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc94b34-9809-404b-bba2-2e74e63bee74]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:15 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:15 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:16 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:16 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Image conversion details: src /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 08:06:16 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Converted 1024.00 MB image at 223.34 MB/s Jul 10 08:06:16 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc is being set with open permissions: ugo+rw Jul 10 08:06:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:16 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc Jul 10 08:06:16 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:17 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" released by "_copy_volume_from_snapshot" :: held 7.851s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892-bb9614ee-481e-431c-a81d-1809d94fc9dc" released by "_create_volume_from_snapshot" :: held 7.902s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.921s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.351s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421721475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:10Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Creating volume fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:17 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:17 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd 1073741824 Jul 10 08:06:17 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4afd7f-5853-48a3-89ec-3ab35917aa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9614ee-481e-431c-a81d-1809d94fc9dc', 'volume_size': 1, 'snapshot_id': '55761fe6-7af2-4f76-b68a-be42ba6ea892'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c725c845-2622-450a-817b-a8fbdf983ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:17 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Volume volume-bb9614ee-481e-431c-a81d-1809d94fc9dc (bb9614ee-481e-431c-a81d-1809d94fc9dc): created successfully Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c725c845-2622-450a-817b-a8fbdf983ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Flow 'volume_create_manager' (107352df-a9e3-4ec2-a34f-0f424b2e1f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-11dfb7b9-355b-4e53-adc5-e59c69370423 tempest-SnapshotDependencyTests-349831953 None] Created volume successfully. Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-55761fe6-7af2-4f76-b68a-be42ba6ea892-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-55761fe6-7af2-4f76-b68a-be42ba6ea892-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Deleting offline snapshot 55761fe6-7af2-4f76-b68a-be42ba6ea892 of volume 1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] snapshot_file for this snap is: volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e20a11-f02e-460e-9352-55871357e7fe]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:17 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd 1073741824" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:17 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:17 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:17 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd Jul 10 08:06:17 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:18 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2799cb6d-764d-475a-ae79-61834e0f23eb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:18 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.943s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Creating offline snapshot 0a3f51d3-e2d6-4f83-8864-d02a64974bc7 of volume 6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13183c15-1808-479f-87d7-ed66ef781df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9cff4b-c4bc-43a5-8771-91721cad1ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604d627-b39a-414e-9a16-31481571ba60]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Volume volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd (fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd): created successfully Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9cff4b-c4bc-43a5-8771-91721cad1ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (e7b19b30-2a3e-461d-9913-93aaa3e90d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:18 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:18 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2b5233c6-650a-4025-a692-cdb360a7b2c0 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:06:18 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 Jul 10 08:06:18 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:19 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.826s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:19 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:19 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:19 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:19 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 1G Jul 10 08:06:19 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=160,cinder:SELECT=110,cinder:INSERT=38,cinder:DELETE=13 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:06:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:20 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:20 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892 Jul 10 08:06:20 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:20 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 1G" returned: 0 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:20 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 Jul 10 08:06:20 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:20 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31.55761fe6-7af2-4f76-b68a-be42ba6ea892" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=116,cinder:UPDATE=144,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-55761fe6-7af2-4f76-b68a-be42ba6ea892" released by "_delete_snapshot" :: held 3.158s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" released by "delete_snapshot" :: held 3.184s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Created reservations ['caeecaaf-9f75-411b-becd-6fa2bf42e609', 'dcdf8542-488e-42e6-bf26-80a14b4f2230', '4c148da2-90ab-4811-8ec7-daf40f61c65b', 'cacfc4fa-7238-4037-a9f5-a0f2e7cde73b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:21 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7" returned: 0 in 0.709s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:21 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 is being set with open permissions: ugo+rw Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:21 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 Jul 10 08:06:21 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Delete snapshot completed successfully. Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f4455d72-bd9f-49aa-bf67-a969d2ac94de tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-55761fe6-7af2-4f76-b68a-be42ba6ea892-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:21 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:21 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info Jul 10 08:06:21 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-1c67cf34-d308-4fcc-b0fa-b351305d2b31-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-1c67cf34-d308-4fcc-b0fa-b351305d2b31-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddffd88-5969-4ac6-9372-a4b5997e59ac]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:22 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:22 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:22 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info is being set with open permissions: ugo+rw Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:22 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info Jul 10 08:06:22 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:22 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:22 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31 Jul 10 08:06:22 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:22 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.info" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.375s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.448s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 18759d28-8977-4e05-ab73-44a72081589b of volume fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f08254b2-6177-4223-b09f-9f52d82e4f22 tempest-ProjectReaderTests-1532914144 None] Create snapshot completed successfully Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[608451a1-a493-400d-acfc-f74b9eb778b3]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:23 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd Jul 10 08:06:23 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-0a3f51d3-e2d6-4f83-8864-d02a64974bc7-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-0a3f51d3-e2d6-4f83-8864-d02a64974bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-0a3f51d3-e2d6-4f83-8864-d02a64974bc7" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-0a3f51d3-e2d6-4f83-8864-d02a64974bc7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Deleting offline snapshot 0a3f51d3-e2d6-4f83-8864-d02a64974bc7 of volume 6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] snapshot_file for this snap is: volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[673043f7-0577-4778-9012-3f8d534331c5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:23 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 Jul 10 08:06:23 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:23 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-1c67cf34-d308-4fcc-b0fa-b351305d2b31" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-1c67cf34-d308-4fcc-b0fa-b351305d2b31" released by "delete_volume" :: held 1.510s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Created reservations ['661d655f-9666-48a7-b124-85250edf43a8', 'ea705b1d-8223-45c8-8ad9-750c78f41e19', '4f1b16fa-3dff-42d1-8cdb-823a0818f5fe', '634e795f-dfd7-49a4-bc93-ba5a6a4c777b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:23 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:23 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:23 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:23 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b 1G Jul 10 08:06:23 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:24 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0c7533-df9f-4a35-b038-0074cfb392b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83b90e-53ff-4fa3-9d9f-b669ffb22a51]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-bb9614ee-481e-431c-a81d-1809d94fc9dc-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-bb9614ee-481e-431c-a81d-1809d94fc9dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:24 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 Jul 10 08:06:24 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e729de50-c8c5-4110-a69f-8b79dc708c4e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:24 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Deleted volume successfully. Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e586afb-b4ec-420e-8f36-a8cd5e71656f tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-1c67cf34-d308-4fcc-b0fa-b351305d2b31-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:24 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc Jul 10 08:06:24 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:24 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b 1G" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:24 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b Jul 10 08:06:24 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:25 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:25 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 Jul 10 08:06:25 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:25 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:25 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc Jul 10 08:06:25 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:25 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:25 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b is being set with open permissions: ugo+rw Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:25 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b Jul 10 08:06:25 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:25 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:25 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7 Jul 10 08:06:25 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:25 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-bb9614ee-481e-431c-a81d-1809d94fc9dc" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-quobyte-bb9614ee-481e-431c-a81d-1809d94fc9dc" released by "delete_volume" :: held 1.565s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Created reservations ['5071b670-7c10-44bf-8a7a-f7f74cc54749', '73584099-66fd-4f52-b2c7-4fad2124b12a', '8b7627c4-bc20-4418-abca-2da225036ebc', '3a836c74-d624-4b4b-8545-f0b39328642e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:26 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:26 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:26 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b" returned: 0 in 0.699s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:26 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info Jul 10 08:06:26 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:26 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9.0a3f51d3-e2d6-4f83-8864-d02a64974bc7" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-0a3f51d3-e2d6-4f83-8864-d02a64974bc7" released by "_delete_snapshot" :: held 3.252s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" released by "delete_snapshot" :: held 3.277s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Created reservations ['14b9f689-72f1-4775-8cf4-0bf6fdd6a2e9', 'f6c3839e-48b7-4fe1-a241-7cbe7b5e017f', '5c1a1cb5-9e26-463d-beed-732a31cf7b1d', 'eb2529aa-59b7-43da-852b-72bdd90dfcad'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Delete snapshot completed successfully. Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-45e11698-ebb2-408e-afa7-40d00237588e tempest-ProjectReaderTests-1532914144 None] Lock "cinder-0a3f51d3-e2d6-4f83-8864-d02a64974bc7-delete_snapshot" released by "delete_snapshot" :: held 3.446s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:26 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Deleted volume successfully. Jul 10 08:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5e1db031-0987-48a5-9448-7d58ec64ce71 tempest-SnapshotDependencyTests-349831953 None] Lock "cinder-bb9614ee-481e-431c-a81d-1809d94fc9dc-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:27 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:27 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info is being set with open permissions: ugo+rw Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:27 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info Jul 10 08:06:27 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-6c0c7533-df9f-4a35-b038-0074cfb392b9-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "cinder-6c0c7533-df9f-4a35-b038-0074cfb392b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51ff18a-1b00-4063-8735-c19dd17d3bb0]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 Jul 10 08:06:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:27 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.info" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.840s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-161c3bb7-f0b9-423d-beb6-0d0918746aa7 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:06:28 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:28 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9 Jul 10 08:06:28 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-18759d28-8977-4e05-ab73-44a72081589b-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-18759d28-8977-4e05-ab73-44a72081589b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-18759d28-8977-4e05-ab73-44a72081589b" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-18759d28-8977-4e05-ab73-44a72081589b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 18759d28-8977-4e05-ab73-44a72081589b of volume fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f052e7-79f8-4d9a-96a5-80ccbc5bde5b]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:29 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b Jul 10 08:06:29 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:29 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6c0c7533-df9f-4a35-b038-0074cfb392b9" returned: 0 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-6c0c7533-df9f-4a35-b038-0074cfb392b9" released by "delete_volume" :: held 1.598s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Created reservations ['bc13dba8-e26c-4714-8f31-598059708b04', '257d9f40-1553-4421-b374-3c2eb8acf89e', 'cd8c5a8b-73d9-4397-996d-3526a9dd788d', 'c8989a19-1175-4a59-bf3b-05cd757434b4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:29 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:29 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:29 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b" returned: 0 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d665f-e5e5-443f-9062-5df3db3cf552]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:30 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd Jul 10 08:06:30 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:30 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Deleted volume successfully. Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-66bf1e22-3a1b-4a68-b9ec-37c9bf0bbe6f tempest-ProjectReaderTests-1532914144 None] Lock "cinder-6c0c7533-df9f-4a35-b038-0074cfb392b9-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (9da11d87-b971-45a1-832d-386bef9b1fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8534504-ee5e-4c0a-b814-457535300cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8534504-ee5e-4c0a-b814-457535300cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887297218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a0edb7-63a6-499a-b61d-cd2fc97e77f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:30Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cda320-675e-4f18-9e2f-a6037627158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cda320-675e-4f18-9e2f-a6037627158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107682d3-47f5-44c3-bc28-ee7f06293a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107682d3-47f5-44c3-bc28-ee7f06293a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a0edb7-63a6-499a-b61d-cd2fc97e77f9', 'volume_name': 'volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d298bdd-86c6-4e76-bb6c-a292cb2d0b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d298bdd-86c6-4e76-bb6c-a292cb2d0b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2777e-cb3c-4e80-9c68-41a516d8247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Volume 31a0edb7-63a6-499a-b61d-cd2fc97e77f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9', 'volume_size': 1} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887297218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a0edb7-63a6-499a-b61d-cd2fc97e77f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6252709744069abcda37efa2fb22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:30Z,use_quota=True,user_id='9df3a3c5be624e7ca0ad0fb2440b6041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Creating volume 31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:30 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 1073741824 Jul 10 08:06:30 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:31 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" returned: 0 in 0.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:31 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b Jul 10 08:06:31 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:31 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 1073741824" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 Jul 10 08:06:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:31 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:31 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b Jul 10 08:06:31 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2777e-cb3c-4e80-9c68-41a516d8247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd6bdd0-7856-4043-87b4-e1f5d2b93cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Volume volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 (31a0edb7-63a6-499a-b61d-cd2fc97e77f9): created successfully Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd6bdd0-7856-4043-87b4-e1f5d2b93cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Flow 'volume_create_manager' (9da11d87-b971-45a1-832d-386bef9b1fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-52fce450-5508-42b0-ac85-59fa2d73974a tempest-ProjectReaderTests-1532914144 None] Created volume successfully. Jul 10 08:06:32 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd.18759d28-8977-4e05-ab73-44a72081589b" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-18759d28-8977-4e05-ab73-44a72081589b" released by "_delete_snapshot" :: held 3.623s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" released by "delete_snapshot" :: held 3.658s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Creating offline snapshot 490605d1-8853-483c-a963-04ca551d449e of volume 31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeac442-5181-44c2-bd26-6c2d5eea2cf9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Created reservations ['05e341e7-7f53-4315-a438-6e4e4279b66d', 'bd45f2b0-9326-4f30-9d7d-951412feff00', '669e6740-669b-4cec-94ba-ed3da0f7fef1', 'e5fa07a7-3d1e-40d6-9078-5e93d8a14360'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:06:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6e06910c-866f-49f0-b9f9-da07197e050a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-18759d28-8977-4e05-ab73-44a72081589b-delete_snapshot" released by "delete_snapshot" :: held 3.838s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:32 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 Jul 10 08:06:32 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a5d88-8f5e-4490-9b6b-98e7e79f2e87]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:33 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd Jul 10 08:06:33 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:33 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" returned: 0 in 0.950s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:33 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e 1G Jul 10 08:06:33 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:34 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" returned: 0 in 0.856s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:34 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd Jul 10 08:06:34 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:34 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e 1G" returned: 0 in 0.938s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:34 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e Jul 10 08:06:34 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:35 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd" released by "delete_volume" :: held 1.703s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Created reservations ['602c4ec7-208a-4b3d-b020-fba5d0d4bfcb', '0d9c94d7-b88f-4529-9190-f6aaf6af9f9e', '141e6d6e-10f6-4315-8673-8c0bcce942e7', '81ef5fab-d177-4548-a8a9-d9d55828c7b7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:35 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:35 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:35 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e is being set with open permissions: ugo+rw Jul 10 08:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:35 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e Jul 10 08:06:35 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:36 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (1d79c7b6-1255-49a1-84b8-f8e9b0e026a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ecda83-6eb9-43bb-a2e5-20b348c1642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ecda83-6eb9-43bb-a2e5-20b348c1642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493306651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b961d9-d7e7-4fd3-953b-d2dab0c270f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:36Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c9e234-34e1-4dad-ba83-25f2f63033c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c9e234-34e1-4dad-ba83-25f2f63033c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8c307b-e91d-4b97-9c57-fe8904f612ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8c307b-e91d-4b97-9c57-fe8904f612ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b961d9-d7e7-4fd3-953b-d2dab0c270f5', 'volume_name': 'volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72da308-9771-4feb-904a-71c250562d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72da308-9771-4feb-904a-71c250562d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab038e79-d04f-4209-8a36-07e80c49892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Volume e8b961d9-d7e7-4fd3-953b-d2dab0c270f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5', 'volume_size': 1} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb3383d2-1b0a-4551-b02a-c7b36a39a9a8 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-fe82b5f7-d9a3-4200-8b3a-6f6ca86d54fd-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:36 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:36 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info Jul 10 08:06:36 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:36 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:36 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:36 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info is being set with open permissions: ugo+rw Jul 10 08:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:36 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info Jul 10 08:06:36 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:37 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:06:37 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.info" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493306651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b961d9-d7e7-4fd3-953b-d2dab0c270f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:36Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Creating volume e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:37 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:37 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 1073741824 Jul 10 08:06:37 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a817e67b-ff4f-4b68-ad32-d6cda671ed5e tempest-ProjectReaderTests-1532914144 None] Create snapshot completed successfully Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-490605d1-8853-483c-a963-04ca551d449e-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-490605d1-8853-483c-a963-04ca551d449e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-490605d1-8853-483c-a963-04ca551d449e" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-490605d1-8853-483c-a963-04ca551d449e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Deleting offline snapshot 490605d1-8853-483c-a963-04ca551d449e of volume 31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] snapshot_file for this snap is: volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5bf629-fb91-4020-b307-f46a3d664cbd]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:38 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e Jul 10 08:06:38 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:38 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 1073741824" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:38 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 Jul 10 08:06:38 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:38 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971bcf0-0dce-4f19-a922-a745e2110649]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:38 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 Jul 10 08:06:38 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:39 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab038e79-d04f-4209-8a36-07e80c49892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79dc818-7fd0-4aab-9c47-321a235bd043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Volume volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 (e8b961d9-d7e7-4fd3-953b-d2dab0c270f5): created successfully Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79dc818-7fd0-4aab-9c47-321a235bd043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (1d79c7b6-1255-49a1-84b8-f8e9b0e026a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2cec2e4a-d9fa-4916-9b4b-1bc27c362dc7 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:06:39 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:39 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e Jul 10 08:06:39 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:40 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:40 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e Jul 10 08:06:40 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot f2c962fc-b5c6-49bd-b66f-407eae059aa6 of volume e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a4432-9e32-43cc-8eee-b1d6fc65f268]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:40 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 Jul 10 08:06:40 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:40 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9.490605d1-8853-483c-a963-04ca551d449e" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-490605d1-8853-483c-a963-04ca551d449e" released by "_delete_snapshot" :: held 3.096s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" released by "delete_snapshot" :: held 3.116s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Created reservations ['7b7ac43b-8243-4039-be02-f4512b7fec40', '006c082a-c296-4620-8946-e49b2f003192', 'aa8bb895-8ecd-4dfe-ad45-f238360df91f', '01532517-0752-4d23-9751-40327387c7e4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Delete snapshot completed successfully. Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfaa904d-1154-4090-be77-66c9bfd30c9b tempest-ProjectReaderTests-1532914144 None] Lock "cinder-490605d1-8853-483c-a963-04ca551d449e-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:41 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" returned: 0 in 0.783s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:41 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 1G Jul 10 08:06:41 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:41 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 1G" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:42 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 Jul 10 08:06:42 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-31a0edb7-63a6-499a-b61d-cd2fc97e77f9-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "cinder-31a0edb7-63a6-499a-b61d-cd2fc97e77f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Acquiring lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2977df-f124-4b28-b01c-9a5fe0d51f54]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:42 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 Jul 10 08:06:42 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:42 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:42 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 is being set with open permissions: ugo+rw Jul 10 08:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:42 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 Jul 10 08:06:42 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:43 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" returned: 0 in 0.769s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:43 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9 Jul 10 08:06:43 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:43 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6" returned: 0 in 0.659s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:43 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info Jul 10 08:06:43 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:43 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "cinder-quobyte-31a0edb7-63a6-499a-b61d-cd2fc97e77f9" released by "delete_volume" :: held 1.507s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Created reservations ['f0170d66-6082-4d7e-be9e-a9855a119181', 'cdc52852-6512-4acd-879a-29c5952eb9bc', 'fab874a4-5638-4409-a21e-2717736083e0', '3009518a-0522-4c21-899f-a9bd34d53639'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:43 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:43 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:44 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:44 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info is being set with open permissions: ugo+rw Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:44 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info Jul 10 08:06:44 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:44 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Deleted volume successfully. Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a57f9260-0a90-4376-ae9d-fde0ea89bb8c tempest-ProjectReaderTests-1532914144 None] Lock "cinder-31a0edb7-63a6-499a-b61d-cd2fc97e77f9-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:44 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.info" returned: 0 in 0.672s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d2bab4ad-e8f5-4f5b-bf93-c2f73ea05882 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-f2c962fc-b5c6-49bd-b66f-407eae059aa6-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-f2c962fc-b5c6-49bd-b66f-407eae059aa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-f2c962fc-b5c6-49bd-b66f-407eae059aa6" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-f2c962fc-b5c6-49bd-b66f-407eae059aa6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot f2c962fc-b5c6-49bd-b66f-407eae059aa6 of volume e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc08ae9f-b55f-46de-8dea-07da6ddb3924]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:45 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 Jul 10 08:06:45 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:46 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:06:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9867f6-684b-4971-b790-246831dac4aa]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:46 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 Jul 10 08:06:46 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:47 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:47 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 Jul 10 08:06:47 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:48 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:48 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6 Jul 10 08:06:48 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:48 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5.f2c962fc-b5c6-49bd-b66f-407eae059aa6" returned: 0 in 0.636s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-f2c962fc-b5c6-49bd-b66f-407eae059aa6" released by "_delete_snapshot" :: held 3.079s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" released by "delete_snapshot" :: held 3.104s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Created reservations ['6d985641-6c4d-404f-a0fe-f99830c34bd2', 'd6321d39-326e-496f-8379-c5c97885903e', 'cf312ccc-71a2-45cb-9e3f-7d748942ecfa', 'e7c77b71-0d67-447d-b36b-c65e57dc0452'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:06:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-24a2196a-733b-465a-a477-33b708fce7c7 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-f2c962fc-b5c6-49bd-b66f-407eae059aa6-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c987330-742a-4ff3-be74-04bcf4c944cf]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:50 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 Jul 10 08:06:50 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:50 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:50 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5 Jul 10 08:06:50 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:51 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5" released by "delete_volume" :: held 1.487s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Created reservations ['b45b0474-7fd8-4d33-a0ea-7955c019042e', '4b2e3236-d37d-4bf8-a003-a4583da2339b', 'fd2da0ab-ce84-40b8-a58f-59c9b33c90b4', 'ccc09656-24ad-45e7-9a4d-2e7a2600d940'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:51 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:06:51 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:52 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:06:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e12b6592-887c-4949-becb-a6d1eccd6624 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-e8b961d9-d7e7-4fd3-953b-d2dab0c270f5-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (63b54161-a131-4570-9af0-c305d69acada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56af4b05-59da-407e-88c7-3a435416dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56af4b05-59da-407e-88c7-3a435416dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487950688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04df8e6-a8ff-40b7-bd7d-e798baa55aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:53Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa47e686-5cf7-44e6-ab6c-8090c79e9598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa47e686-5cf7-44e6-ab6c-8090c79e9598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3591644-c322-46f5-a260-aa50e8124145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3591644-c322-46f5-a260-aa50e8124145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04df8e6-a8ff-40b7-bd7d-e798baa55aac', 'volume_name': 'volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1570d5ea-4643-4fd8-9b6f-f2a1aeb2bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1570d5ea-4643-4fd8-9b6f-f2a1aeb2bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5e9db5-53f0-4a00-a004-1bf36d1ce38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Volume b04df8e6-a8ff-40b7-bd7d-e798baa55aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac', 'volume_size': 1} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-487950688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04df8e6-a8ff-40b7-bd7d-e798baa55aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:53Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Creating volume b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:52 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:52 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac 1073741824 Jul 10 08:06:52 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:53 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac 1073741824" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:53 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac Jul 10 08:06:53 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:54 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5e9db5-53f0-4a00-a004-1bf36d1ce38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad6b5a4-c9bb-4f45-8d32-3abffa022917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Volume volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac (b04df8e6-a8ff-40b7-bd7d-e798baa55aac): created successfully Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad6b5a4-c9bb-4f45-8d32-3abffa022917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (63b54161-a131-4570-9af0-c305d69acada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9bd959f4-ba1c-4138-9898-a777a84c42e9 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 9b3913b0-e484-42cb-9836-4dcd411a1bd7 of volume b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc75e8-6bf0-4357-a6df-9d3a271d9871]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:54 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac Jul 10 08:06:54 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:55 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:55 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 1G Jul 10 08:06:55 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:06:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Flow 'volume_create_manager' (2f8f720e-7427-4290-b979-e2a4c2607884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c51822e-2925-423e-9973-8a3d37778210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c51822e-2925-423e-9973-8a3d37778210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345917637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d13a32-9e7f-4fac-851f-29b3717e7b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3a97d818704bf89b6be79e93d94770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:56Z,use_quota=True,user_id='270ba1afc47d400aa4c4ff6bac7b1bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b14fd9-16c2-4473-b53c-66688ed918b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b14fd9-16c2-4473-b53c-66688ed918b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88246d46-d24b-4d2d-9e7c-2b27d12683f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88246d46-d24b-4d2d-9e7c-2b27d12683f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d13a32-9e7f-4fac-851f-29b3717e7b67', 'volume_name': 'volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6365a4ac-bbed-4056-bb5e-9f689e711c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6365a4ac-bbed-4056-bb5e-9f689e711c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31459aca-08a3-440f-b9ba-ad4ffaaf5371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:06:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Volume a5d13a32-9e7f-4fac-851f-29b3717e7b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67', 'volume_size': 1} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:56 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 1G" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:56 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 Jul 10 08:06:56 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:57 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:57 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 is being set with open permissions: ugo+rw Jul 10 08:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:57 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 Jul 10 08:06:57 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:57 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:57 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info Jul 10 08:06:57 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:58 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:58 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info is being set with open permissions: ugo+rw Jul 10 08:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:58 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info Jul 10 08:06:58 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:59 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.info" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345917637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d13a32-9e7f-4fac-851f-29b3717e7b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3a97d818704bf89b6be79e93d94770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:06:56Z,use_quota=True,user_id='270ba1afc47d400aa4c4ff6bac7b1bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Creating volume a5d13a32-9e7f-4fac-851f-29b3717e7b67 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:06:59 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:59 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 1073741824 Jul 10 08:06:59 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:06:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-657f4cc9-499d-416c-8fb2-d8d219cc5dcb tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:06:59 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 1073741824" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:06:59 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 Jul 10 08:06:59 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-9b3913b0-e484-42cb-9836-4dcd411a1bd7-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-9b3913b0-e484-42cb-9836-4dcd411a1bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-9b3913b0-e484-42cb-9836-4dcd411a1bd7" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-9b3913b0-e484-42cb-9836-4dcd411a1bd7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 9b3913b0-e484-42cb-9836-4dcd411a1bd7 of volume b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6748c-681d-4872-b712-5f255277eec7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:00 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 Jul 10 08:07:00 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:00 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31459aca-08a3-440f-b9ba-ad4ffaaf5371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579b078a-1000-4a01-8929-952bfd08914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Volume volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 (a5d13a32-9e7f-4fac-851f-29b3717e7b67): created successfully Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579b078a-1000-4a01-8929-952bfd08914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Flow 'volume_create_manager' (2f8f720e-7427-4290-b979-e2a4c2607884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1e8bc37b-56ea-4da2-bede-3ccac59c6821 tempest-ProjectReaderTests-577169033 None] Created volume successfully. Jul 10 08:07:00 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555e686-b98a-44d0-a79f-398c0bb42144]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:01 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac Jul 10 08:07:01 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Acquiring lock "cinder-a5d13a32-9e7f-4fac-851f-29b3717e7b67-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "cinder-a5d13a32-9e7f-4fac-851f-29b3717e7b67-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Acquiring lock "cinder-quobyte-a5d13a32-9e7f-4fac-851f-29b3717e7b67" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "cinder-quobyte-a5d13a32-9e7f-4fac-851f-29b3717e7b67" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39f50b-87e8-4bd6-9e04-524fad12907c]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:01 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 Jul 10 08:07:01 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:01 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:01 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 Jul 10 08:07:01 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:02 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:02 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67 Jul 10 08:07:02 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:02 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7" returned: 0 in 0.744s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:02 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7 Jul 10 08:07:02 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:03 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-a5d13a32-9e7f-4fac-851f-29b3717e7b67" returned: 0 in 0.693s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "cinder-quobyte-a5d13a32-9e7f-4fac-851f-29b3717e7b67" released by "delete_volume" :: held 1.552s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Created reservations ['7b82940b-65e5-4199-a137-e2df12abe801', '7c360227-f744-4d97-986a-154734e92444', 'd765055b-e863-4277-860d-8e62615baeea', 'b2133846-8681-421a-a83f-97373b9cbc0d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:03 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac.9b3913b0-e484-42cb-9836-4dcd411a1bd7" returned: 0 in 0.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-9b3913b0-e484-42cb-9836-4dcd411a1bd7" released by "_delete_snapshot" :: held 3.101s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" released by "delete_snapshot" :: held 3.128s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:03 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:03 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Created reservations ['4428bf2e-b528-4e89-8163-cc6f796c41b3', '90381d47-3260-44ee-b818-0203223c65d4', '2a35d8cc-e904-4ded-b666-20a4bc8534e1', '9b76efc7-d702-48e6-8228-74a63bbd709a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8e1e2ef3-29ff-4e44-9fc1-7d05a17617bd tempest-ProjectMemberTests-2000425353 None] Lock "cinder-9b3913b0-e484-42cb-9836-4dcd411a1bd7-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:03 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Deleted volume successfully. Jul 10 08:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-268a24fc-856f-47ff-84dc-adcc83f3d316 tempest-ProjectReaderTests-577169033 None] Lock "cinder-a5d13a32-9e7f-4fac-851f-29b3717e7b67-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Flow 'volume_create_manager' (c69f5922-6fbd-49cf-ae5b-deeea15d881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46264f03-a2b4-4619-bde2-cd5c814af89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46264f03-a2b4-4619-bde2-cd5c814af89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131170229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4b9c1-87be-4c21-9a24-eec86d082a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3a97d818704bf89b6be79e93d94770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:04Z,use_quota=True,user_id='270ba1afc47d400aa4c4ff6bac7b1bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9428a89-27b6-4434-a811-9ce69d863e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9428a89-27b6-4434-a811-9ce69d863e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c060b443-fc04-4b05-b50e-528bba519b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c060b443-fc04-4b05-b50e-528bba519b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db4b9c1-87be-4c21-9a24-eec86d082a50', 'volume_name': 'volume-7db4b9c1-87be-4c21-9a24-eec86d082a50', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d266e5-9183-4504-9372-dadbe40a6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d266e5-9183-4504-9372-dadbe40a6372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a7f6fb-d2af-4f3d-a40d-2b2423aaad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Volume 7db4b9c1-87be-4c21-9a24-eec86d082a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db4b9c1-87be-4c21-9a24-eec86d082a50', 'volume_size': 1} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131170229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4b9c1-87be-4c21-9a24-eec86d082a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3a97d818704bf89b6be79e93d94770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:04Z,use_quota=True,user_id='270ba1afc47d400aa4c4ff6bac7b1bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Creating volume 7db4b9c1-87be-4c21-9a24-eec86d082a50 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:04 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 1073741824 Jul 10 08:07:04 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-b04df8e6-a8ff-40b7-bd7d-e798baa55aac-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-b04df8e6-a8ff-40b7-bd7d-e798baa55aac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c0b3d-458d-479a-b9d2-9a4d15d8354e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:04 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac Jul 10 08:07:04 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:04 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 1073741824" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:05 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 Jul 10 08:07:05 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:05 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:05 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac Jul 10 08:07:05 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:05 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50" returned: 0 in 0.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a7f6fb-d2af-4f3d-a40d-2b2423aaad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db4b9c1-87be-4c21-9a24-eec86d082a50', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1466300b-155e-427d-bd7e-d2737b6fcc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Volume volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 (7db4b9c1-87be-4c21-9a24-eec86d082a50): created successfully Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1466300b-155e-427d-bd7e-d2737b6fcc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Flow 'volume_create_manager' (c69f5922-6fbd-49cf-ae5b-deeea15d881a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-be65643b-4b55-41ee-b928-21192a4d78be tempest-ProjectReaderTests-577169033 None] Created volume successfully. Jul 10 08:07:05 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" returned: 0 in 0.644s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b04df8e6-a8ff-40b7-bd7d-e798baa55aac" released by "delete_volume" :: held 1.477s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Created reservations ['fe65f44f-b669-4e35-ae60-06f1775e4589', 'e61bae17-ae69-42a3-90a1-cbbc79aadd7f', '9f16f752-d203-4fd2-8c64-3f675810e0b6', '751a41aa-ab86-4711-94d4-69c6d8ebe9db'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:05 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:05 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Acquiring lock "cinder-7db4b9c1-87be-4c21-9a24-eec86d082a50-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "cinder-7db4b9c1-87be-4c21-9a24-eec86d082a50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Acquiring lock "cinder-quobyte-7db4b9c1-87be-4c21-9a24-eec86d082a50" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "cinder-quobyte-7db4b9c1-87be-4c21-9a24-eec86d082a50" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee0ab9d-2513-43bd-8964-56c195a147aa]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:06 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 Jul 10 08:07:06 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:06 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-93e8d444-fd53-4da6-b4b1-54d98f044869 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-b04df8e6-a8ff-40b7-bd7d-e798baa55aac-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (15dec94b-8b8b-4d1d-af33-20391fc77bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fae035-465c-4f38-95d2-2822450f3eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fae035-465c-4f38-95d2-2822450f3eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082255092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a84716-28fc-4606-ae95-d2721afe7752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:07Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5c92f7-f0a6-406d-9afd-1cb2537c93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5c92f7-f0a6-406d-9afd-1cb2537c93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df50dd5-4d78-4ee0-81ba-7cc74e966ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df50dd5-4d78-4ee0-81ba-7cc74e966ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a84716-28fc-4606-ae95-d2721afe7752', 'volume_name': 'volume-b5a84716-28fc-4606-ae95-d2721afe7752', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb587c8-0180-4be5-87d7-adc8f17f3b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb587c8-0180-4be5-87d7-adc8f17f3b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3444b4-246e-4209-bcf5-f3479aeb5100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Volume b5a84716-28fc-4606-ae95-d2721afe7752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a84716-28fc-4606-ae95-d2721afe7752', 'volume_size': 1} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082255092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a84716-28fc-4606-ae95-d2721afe7752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:07Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Creating volume b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:07 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 1073741824 Jul 10 08:07:07 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:07 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:07 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50 Jul 10 08:07:07 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:07 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-7db4b9c1-87be-4c21-9a24-eec86d082a50" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "cinder-quobyte-7db4b9c1-87be-4c21-9a24-eec86d082a50" released by "delete_volume" :: held 1.487s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Created reservations ['282e0586-f498-4d45-9ddd-7773d9280eca', '2e41d805-b7d6-475a-8857-180c4fa61a39', '9398f4ff-8963-4e7c-b22d-5f77cb234c10', 'e41e4e20-391b-47b7-b716-2554fa63a17d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:07 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 1073741824" returned: 0 in 0.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:07 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:07 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:07 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 Jul 10 08:07:07 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:08 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.698s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Deleted volume successfully. Jul 10 08:07:08 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3444b4-246e-4209-bcf5-f3479aeb5100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a84716-28fc-4606-ae95-d2721afe7752', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd52aa2-eb2b-4007-a77d-21070b728d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-956892b8-c836-4812-819f-56ca6d441b9b tempest-ProjectReaderTests-577169033 None] Lock "cinder-7db4b9c1-87be-4c21-9a24-eec86d082a50-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Volume volume-b5a84716-28fc-4606-ae95-d2721afe7752 (b5a84716-28fc-4606-ae95-d2721afe7752): created successfully Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd52aa2-eb2b-4007-a77d-21070b728d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (15dec94b-8b8b-4d1d-af33-20391fc77bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-af35daaf-5b47-4cf9-9a48-8b26421a7fae tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:07:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 7a32509f-155e-457b-bbc9-b66cd58a7e16 of volume b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:07:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fcbcea-46f6-4bd7-8afd-b7363048a998]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:09 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 Jul 10 08:07:09 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:10 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:10 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 1G Jul 10 08:07:10 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:10 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 1G" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a84716-28fc-4606-ae95-d2721afe7752 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:10 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a84716-28fc-4606-ae95-d2721afe7752 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 Jul 10 08:07:10 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:11 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a84716-28fc-4606-ae95-d2721afe7752 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 is being set with open permissions: ugo+rw Jul 10 08:07:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:11 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 Jul 10 08:07:11 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:12 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (0d3a2c8a-31d2-40c2-9380-e68d32d368e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d79e8b6-ae62-45b7-806f-b304f59e24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d79e8b6-ae62-45b7-806f-b304f59e24c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389745825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42284de-c939-464d-b323-69e21ee62bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:12Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:12 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info Jul 10 08:07:12 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e963396-0a11-4e6a-94c1-b92a242038ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e963396-0a11-4e6a-94c1-b92a242038ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfa71bb-78b9-4535-96e5-63f6e314e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfa71bb-78b9-4535-96e5-63f6e314e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42284de-c939-464d-b323-69e21ee62bf7', 'volume_name': 'volume-c42284de-c939-464d-b323-69e21ee62bf7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53aac3-5564-4b26-8cc8-8ea4df973e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53aac3-5564-4b26-8cc8-8ea4df973e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848c9544-e829-4072-9478-c076d9597a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Volume c42284de-c939-464d-b323-69e21ee62bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42284de-c939-464d-b323-69e21ee62bf7', 'volume_size': 1} Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:12 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:12 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info is being set with open permissions: ugo+rw Jul 10 08:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:13 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info Jul 10 08:07:13 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:13 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.info" returned: 0 in 0.636s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389745825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42284de-c939-464d-b323-69e21ee62bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:12Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Creating volume c42284de-c939-464d-b323-69e21ee62bf7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:13 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 1073741824 Jul 10 08:07:13 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fa3ad228-7f50-4a8e-a665-99d116dc0267 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-7a32509f-155e-457b-bbc9-b66cd58a7e16-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-7a32509f-155e-457b-bbc9-b66cd58a7e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-7a32509f-155e-457b-bbc9-b66cd58a7e16" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-7a32509f-155e-457b-bbc9-b66cd58a7e16" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 7a32509f-155e-457b-bbc9-b66cd58a7e16 of volume b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14d37c-cdaa-4167-8037-af35ac866def]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:14 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 1073741824" returned: 0 in 0.846s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:14 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 Jul 10 08:07:14 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:14 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 Jul 10 08:07:14 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:15 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7" returned: 0 in 0.652s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848c9544-e829-4072-9478-c076d9597a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42284de-c939-464d-b323-69e21ee62bf7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1cc6f3-955b-4d5b-aa01-d04a4d096b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Volume volume-c42284de-c939-464d-b323-69e21ee62bf7 (c42284de-c939-464d-b323-69e21ee62bf7): created successfully Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1cc6f3-955b-4d5b-aa01-d04a4d096b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (0d3a2c8a-31d2-40c2-9380-e68d32d368e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6c81b991-6036-454d-9c95-72e51ef8b7bc tempest-ProjectReaderTests-2137730531 None] Created volume successfully. Jul 10 08:07:15 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a84716-28fc-4606-ae95-d2721afe7752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc64a9dc-a2fe-4b67-9625-75449cb991f9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:15 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 Jul 10 08:07:15 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-c42284de-c939-464d-b323-69e21ee62bf7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-c42284de-c939-464d-b323-69e21ee62bf7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-quobyte-c42284de-c939-464d-b323-69e21ee62bf7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-c42284de-c939-464d-b323-69e21ee62bf7" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9eac3d-5756-4235-8342-b64b9af741f1]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:15 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 Jul 10 08:07:15 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:16 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:16 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 Jul 10 08:07:16 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:16 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:16 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7 Jul 10 08:07:16 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:16 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:16 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16 Jul 10 08:07:16 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:17 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c42284de-c939-464d-b323-69e21ee62bf7" returned: 0 in 0.672s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-c42284de-c939-464d-b323-69e21ee62bf7" released by "delete_volume" :: held 1.515s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Created reservations ['e27d8fc0-ca4f-44cd-b020-3cb22d0ae1e0', '76125fd3-6887-4fd7-8350-2232b1d362f3', '1013e7a2-e49d-4cf4-b410-e58f45336ea9', 'b20f2a69-b010-4a4b-9f51-131f0187d0b4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:17 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:17 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:17 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752.7a32509f-155e-457b-bbc9-b66cd58a7e16" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-7a32509f-155e-457b-bbc9-b66cd58a7e16" released by "_delete_snapshot" :: held 3.099s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" released by "delete_snapshot" :: held 3.119s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Created reservations ['b772d5cb-c439-4a46-bb62-da8656059cf9', 'd2f3e6c2-cedc-44b6-914e-24521230df1e', 'ca40a118-22c7-4723-b697-e07c1fcfdccb', '06d25d6f-f170-4f04-99a0-10615e812781'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-157dd958-60ce-46e7-85ad-304f55db4490 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-7a32509f-155e-457b-bbc9-b66cd58a7e16-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:17 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Deleted volume successfully. Jul 10 08:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8a946104-ecfe-4b6e-80ee-b5e844987840 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-c42284de-c939-464d-b323-69e21ee62bf7-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (831bd70e-0680-46c5-8c52-2837cb7a0f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8451bbb1-ad3d-454b-a925-54b6fa343653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8451bbb1-ad3d-454b-a925-54b6fa343653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928813414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f4ce41-cce4-41e8-8ab7-ca986a31809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:18Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd74cef9-d5f2-431d-965f-554be254c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd74cef9-d5f2-431d-965f-554be254c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c76da7-9841-4ec7-92c8-2cd41a395de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c76da7-9841-4ec7-92c8-2cd41a395de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f4ce41-cce4-41e8-8ab7-ca986a31809f', 'volume_name': 'volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c57e52-db00-4a42-94ce-d41c2388c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c57e52-db00-4a42-94ce-d41c2388c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818fb3fb-39b8-4165-9496-60da25ed8f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Volume f2f4ce41-cce4-41e8-8ab7-ca986a31809f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f', 'volume_size': 1} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928813414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f4ce41-cce4-41e8-8ab7-ca986a31809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:18Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Creating volume f2f4ce41-cce4-41e8-8ab7-ca986a31809f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:18 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:18 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f 1073741824 Jul 10 08:07:18 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-b5a84716-28fc-4606-ae95-d2721afe7752-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-b5a84716-28fc-4606-ae95-d2721afe7752-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f475261-594b-4ede-ab06-67400e25f3e5]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:18 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 Jul 10 08:07:18 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:19 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f 1073741824" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:19 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f Jul 10 08:07:19 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:19 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:19 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752 Jul 10 08:07:19 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:19 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818fb3fb-39b8-4165-9496-60da25ed8f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f617490-f991-4f93-bfc4-32acb9c4e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=115,cinder:INSERT=40,cinder:UPDATE=148,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:07:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Volume volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f (f2f4ce41-cce4-41e8-8ab7-ca986a31809f): created successfully Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f617490-f991-4f93-bfc4-32acb9c4e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (831bd70e-0680-46c5-8c52-2837cb7a0f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a6502c5a-6ca6-4f9a-96aa-cd903b6ba08d tempest-ProjectReaderTests-2137730531 None] Created volume successfully. Jul 10 08:07:20 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-b5a84716-28fc-4606-ae95-d2721afe7752" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-b5a84716-28fc-4606-ae95-d2721afe7752" released by "delete_volume" :: held 1.491s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Created reservations ['f91c0dcb-0828-42e8-8683-43f29dd94384', 'cac8d042-a413-4215-a97f-ec75bf84e008', '5f777e8e-f384-4d57-a03c-c604c210c4c1', 'c56f2099-5a4a-4034-a438-e2efcee8de7c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:20 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:20 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-f2f4ce41-cce4-41e8-8ab7-ca986a31809f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "cinder-f2f4ce41-cce4-41e8-8ab7-ca986a31809f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-quobyte-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9001f-edf2-42db-a445-a3383a68a70f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:20 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f Jul 10 08:07:20 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:21 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.670s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=121,cinder:INSERT=44,cinder:UPDATE=164,cinder:DELETE=18 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-83ce5aa3-168b-4249-ba1d-5f75ace4ebd9 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-b5a84716-28fc-4606-ae95-d2721afe7752-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:21 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:21 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f Jul 10 08:07:21 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (d36bb84e-f724-487a-88e2-55baaac9402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e3109-6b7d-4056-9cc2-4a0f0fbf58de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e3109-6b7d-4056-9cc2-4a0f0fbf58de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425783858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c2862-d703-42e6-ad2d-66d3edd74cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:21Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d0a047-6aa6-4611-80df-5372664e2798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d0a047-6aa6-4611-80df-5372664e2798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5081887-7e3a-444c-8ca1-75d006a72956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5081887-7e3a-444c-8ca1-75d006a72956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344c2862-d703-42e6-ad2d-66d3edd74cfe', 'volume_name': 'volume-344c2862-d703-42e6-ad2d-66d3edd74cfe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f13269-cb43-45ac-88c1-6ce294d28ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f13269-cb43-45ac-88c1-6ce294d28ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be4e90-02bc-4ce3-802e-b94b8ac4dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Volume 344c2862-d703-42e6-ad2d-66d3edd74cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344c2862-d703-42e6-ad2d-66d3edd74cfe', 'volume_size': 1} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425783858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c2862-d703-42e6-ad2d-66d3edd74cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:21Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Creating volume 344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:21 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe 1073741824 Jul 10 08:07:21 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:21 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" returned: 0 in 0.670s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-f2f4ce41-cce4-41e8-8ab7-ca986a31809f" released by "delete_volume" :: held 1.523s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Created reservations ['56712c67-b32f-44c5-a297-0fc28b58a094', '1c40cffd-b59e-4cb4-9b96-9f034a835543', 'c201b8c5-8e11-464a-9c9f-fc3ce5d92d67', '55878c70-1cdb-4bbe-b392-10c1c7198338'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:22 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:22 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:22 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe 1073741824" returned: 0 in 0.871s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:22 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe Jul 10 08:07:22 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:22 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Deleted volume successfully. Jul 10 08:07:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb7a49f8-a696-4a45-bdeb-29962c1e6e1d tempest-ProjectReaderTests-2137730531 None] Lock "cinder-f2f4ce41-cce4-41e8-8ab7-ca986a31809f-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:23 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe" returned: 0 in 0.669s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be4e90-02bc-4ce3-802e-b94b8ac4dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344c2862-d703-42e6-ad2d-66d3edd74cfe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06564d-d6e2-4f6c-8b26-5d9977d64efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (ff876cfc-b107-41d0-8b29-fc0f3d016ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8f2a2f-a2ae-49cb-bc1e-5523eb3fac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Volume volume-344c2862-d703-42e6-ad2d-66d3edd74cfe (344c2862-d703-42e6-ad2d-66d3edd74cfe): created successfully Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06564d-d6e2-4f6c-8b26-5d9977d64efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (d36bb84e-f724-487a-88e2-55baaac9402e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8f2a2f-a2ae-49cb-bc1e-5523eb3fac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828624225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd8d7ef-2b35-45ab-b70b-03f917128ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:23Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795d52b9-e0f3-4e4a-bd48-5e4b79c1c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795d52b9-e0f3-4e4a-bd48-5e4b79c1c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9307b26-3457-481b-98cd-7a7be911be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9307b26-3457-481b-98cd-7a7be911be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd8d7ef-2b35-45ab-b70b-03f917128ab5', 'volume_name': 'volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22be8209-9f8c-4f96-b9c8-faeaee89c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22be8209-9f8c-4f96-b9c8-faeaee89c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf66aec-acb2-424e-9815-140782035266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Volume ffd8d7ef-2b35-45ab-b70b-03f917128ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5', 'volume_size': 1} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828624225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd8d7ef-2b35-45ab-b70b-03f917128ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:23Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Creating volume ffd8d7ef-2b35-45ab-b70b-03f917128ab5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:23 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b0992174-0713-4151-8611-92bf4689876b tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:07:23 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 1073741824 Jul 10 08:07:23 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:23 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 1073741824" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:24 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 Jul 10 08:07:24 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:24 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.060s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf66aec-acb2-424e-9815-140782035266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41656121-7425-4bba-a314-3d7c43886924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 38bdfb9c-bcd9-47c7-b2e8-127c618fd583 of volume 344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:07:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Volume volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 (ffd8d7ef-2b35-45ab-b70b-03f917128ab5): created successfully Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41656121-7425-4bba-a314-3d7c43886924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (ff876cfc-b107-41d0-8b29-fc0f3d016ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcf3781-d8b7-4afc-948f-d9e883c688fb]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cc283c5f-7f25-49f4-9cfd-ff86b16ee6b9 tempest-ProjectReaderTests-2137730531 None] Created volume successfully. Jul 10 08:07:24 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe Jul 10 08:07:24 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-ffd8d7ef-2b35-45ab-b70b-03f917128ab5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "cinder-ffd8d7ef-2b35-45ab-b70b-03f917128ab5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-quobyte-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7cb7f2-5fa7-41c7-b737-db534608f64f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:25 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 Jul 10 08:07:25 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:25 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:25 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 1G Jul 10 08:07:25 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:26 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:26 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5 Jul 10 08:07:26 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:26 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 1G" returned: 0 in 0.831s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c2862-d703-42e6-ad2d-66d3edd74cfe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:26 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c2862-d703-42e6-ad2d-66d3edd74cfe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 Jul 10 08:07:26 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:26 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-ffd8d7ef-2b35-45ab-b70b-03f917128ab5" released by "delete_volume" :: held 1.475s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Created reservations ['81f6a451-d254-4549-8597-329a1ebe79d4', 'abea5bf0-8f43-4bca-b188-7ef0dfa6ef0d', '325d652a-ce29-40a1-9377-2fe39d43e73a', '3490e68d-bc53-427a-89e6-fc574b5fe0d3'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:26 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:26 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:27 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-344c2862-d703-42e6-ad2d-66d3edd74cfe -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:27 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 is being set with open permissions: ugo+rw Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:27 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 Jul 10 08:07:27 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:27 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.698s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Deleted volume successfully. Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8d0c638-b9ff-44a1-a5ef-22051745368f tempest-ProjectReaderTests-2137730531 None] Lock "cinder-ffd8d7ef-2b35-45ab-b70b-03f917128ab5-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:27 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:27 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info Jul 10 08:07:27 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (ac5550fb-f49d-42e3-ac73-fb039e940078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0b2e55-274b-422e-a33a-4bd734084292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0b2e55-274b-422e-a33a-4bd734084292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626974057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6457ba71-0797-4ca8-b31f-1bd79e2fe74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:28Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc429184-8abd-4f0b-ac7d-f69d29d6b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc429184-8abd-4f0b-ac7d-f69d29d6b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f40c4c-7257-441e-b4d5-a74edb4a546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f40c4c-7257-441e-b4d5-a74edb4a546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6457ba71-0797-4ca8-b31f-1bd79e2fe74e', 'volume_name': 'volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194adff4-2e29-4716-8ebe-9743b29364c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194adff4-2e29-4716-8ebe-9743b29364c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb55505-e35b-4f17-bfcb-14b40966e5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Volume 6457ba71-0797-4ca8-b31f-1bd79e2fe74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e', 'volume_size': 1} Jul 10 08:07:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:28 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:28 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info is being set with open permissions: ugo+rw Jul 10 08:07:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:28 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info Jul 10 08:07:28 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:29 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.info" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.397s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626974057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6457ba71-0797-4ca8-b31f-1bd79e2fe74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f08e18f0a146b6aa2509bdb84a02aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:28Z,use_quota=True,user_id='eaf9b8853e55449aa842f5e2c86d8178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Creating volume 6457ba71-0797-4ca8-b31f-1bd79e2fe74e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:29 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e 1073741824 Jul 10 08:07:29 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e1a9af92-1cb6-422a-8e99-04dcc032f9c1 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-38bdfb9c-bcd9-47c7-b2e8-127c618fd583-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:29 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e 1073741824" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-38bdfb9c-bcd9-47c7-b2e8-127c618fd583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-38bdfb9c-bcd9-47c7-b2e8-127c618fd583" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-38bdfb9c-bcd9-47c7-b2e8-127c618fd583" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 38bdfb9c-bcd9-47c7-b2e8-127c618fd583 of volume 344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df581e9-f070-4e8b-885f-af3760ec5d70]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:30 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e Jul 10 08:07:30 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:30 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 Jul 10 08:07:30 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:30 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb55505-e35b-4f17-bfcb-14b40966e5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff501adf-0684-481e-88d0-d86dd0a09239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Volume volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e (6457ba71-0797-4ca8-b31f-1bd79e2fe74e): created successfully Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff501adf-0684-481e-88d0-d86dd0a09239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Flow 'volume_create_manager' (ac5550fb-f49d-42e3-ac73-fb039e940078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-426d9826-0b9b-4ca1-8749-9640ab82ce0e tempest-ProjectReaderTests-2137730531 None] Created volume successfully. Jul 10 08:07:30 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-344c2862-d703-42e6-ad2d-66d3edd74cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55a69e-aa50-49d8-ade3-49f3a83456c6]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:30 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe Jul 10 08:07:30 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-6457ba71-0797-4ca8-b31f-1bd79e2fe74e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-6457ba71-0797-4ca8-b31f-1bd79e2fe74e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "cinder-quobyte-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a519fe-ac64-4511-9da2-2c795bcccb65]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:31 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e Jul 10 08:07:31 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:31 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:31 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 Jul 10 08:07:31 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:31 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:31 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e Jul 10 08:07:31 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:32 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:32 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583 Jul 10 08:07:32 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:32 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-quobyte-6457ba71-0797-4ca8-b31f-1bd79e2fe74e" released by "delete_volume" :: held 1.517s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Created reservations ['392633ba-8afa-45e0-95cd-a7327fa92263', '1ab34889-c78d-4206-9bca-7af34ee5001f', 'a51c563e-5a30-47b0-86cf-b2b246b5c8f1', '8b7a96a4-f9e6-4658-bf14-facc8d9bb7dc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:32 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:32 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:32 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe.38bdfb9c-bcd9-47c7-b2e8-127c618fd583" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-38bdfb9c-bcd9-47c7-b2e8-127c618fd583" released by "_delete_snapshot" :: held 3.060s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" released by "delete_snapshot" :: held 3.086s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Created reservations ['f84b0ad1-8a63-4218-9fc0-faa6265219fc', 'a90a8d4b-6746-44d2-8e3b-32bf971b7b1a', '542c822a-99d1-44ed-9278-fba5f2970d23', 'be84daf1-fea2-4922-b83a-1fc56e889226'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-25a65e85-f576-4167-a795-5a7e1624766b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-38bdfb9c-bcd9-47c7-b2e8-127c618fd583-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:33 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Deleted volume successfully. Jul 10 08:07:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b7305906-339d-4c96-8994-5cc214586777 tempest-ProjectReaderTests-2137730531 None] Lock "cinder-6457ba71-0797-4ca8-b31f-1bd79e2fe74e-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-344c2862-d703-42e6-ad2d-66d3edd74cfe-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-344c2862-d703-42e6-ad2d-66d3edd74cfe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0209a99c-ba65-4c76-bd19-cb3d641ee3dc]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:34 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe Jul 10 08:07:34 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:35 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:35 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe Jul 10 08:07:35 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:35 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-344c2862-d703-42e6-ad2d-66d3edd74cfe" returned: 0 in 0.644s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-344c2862-d703-42e6-ad2d-66d3edd74cfe" released by "delete_volume" :: held 1.504s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Created reservations ['ed352c53-9f10-466c-bf10-f83050c59f40', 'ccd95b25-4ba1-4482-b166-79e97ceab9cb', '007d1db7-e4b2-4a4c-ae96-c1ecc0680b30', 'd0a83ca3-cb06-440e-a249-a5b1506525a0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:35 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:35 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:36 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:07:36 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:36 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e212ada9-0bc8-4395-a425-e316fa18dd69 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-344c2862-d703-42e6-ad2d-66d3edd74cfe-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (2c45f7ee-6ee5-4488-a834-408ba4edb69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a6005f-4018-40c3-9773-7bfce7d70789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a6005f-4018-40c3-9773-7bfce7d70789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-775390285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca809ee1-d670-4981-a650-651cc076af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:37Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27635c70-d846-42ab-9393-5a3335f48a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27635c70-d846-42ab-9393-5a3335f48a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe4352-48df-481a-842d-1a8579060647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe4352-48df-481a-842d-1a8579060647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca809ee1-d670-4981-a650-651cc076af94', 'volume_name': 'volume-ca809ee1-d670-4981-a650-651cc076af94', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f32d73-d3ba-49a5-abe9-886d7659c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f32d73-d3ba-49a5-abe9-886d7659c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c2578-4543-4721-a007-de13076d7f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Volume ca809ee1-d670-4981-a650-651cc076af94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca809ee1-d670-4981-a650-651cc076af94', 'volume_size': 1} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-775390285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca809ee1-d670-4981-a650-651cc076af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:37Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Creating volume ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:36 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 1073741824 Jul 10 08:07:36 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:37 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:07:37 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 1073741824" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:37 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 Jul 10 08:07:37 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:38 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94" returned: 0 in 0.662s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c2578-4543-4721-a007-de13076d7f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca809ee1-d670-4981-a650-651cc076af94', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8095b4e4-8e7b-47d0-a6cf-a43854599ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Volume volume-ca809ee1-d670-4981-a650-651cc076af94 (ca809ee1-d670-4981-a650-651cc076af94): created successfully Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8095b4e4-8e7b-47d0-a6cf-a43854599ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (2c45f7ee-6ee5-4488-a834-408ba4edb69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-16e2a210-6807-4aa6-8a89-ab7f0d1d7883 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 0d572d5d-bb38-4bb6-8a00-3f4918dcb06a of volume ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f66396-0d81-404f-87bb-22dce350f6c7]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:39 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 Jul 10 08:07:39 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:39 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:39 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a 1G Jul 10 08:07:39 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:40 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a 1G" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca809ee1-d670-4981-a650-651cc076af94 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:40 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca809ee1-d670-4981-a650-651cc076af94 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a Jul 10 08:07:40 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:41 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca809ee1-d670-4981-a650-651cc076af94 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a is being set with open permissions: ugo+rw Jul 10 08:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:41 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a Jul 10 08:07:41 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:41 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:41 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info Jul 10 08:07:41 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:42 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:42 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info is being set with open permissions: ugo+rw Jul 10 08:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:42 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info Jul 10 08:07:42 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:43 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.info" returned: 0 in 0.622s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c5f84d3c-e221-46f3-87b0-50a449dee828 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 0d572d5d-bb38-4bb6-8a00-3f4918dcb06a of volume ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9032a4ac-0204-499d-b0aa-c193e080ce7d]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:44 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a Jul 10 08:07:44 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:45 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca809ee1-d670-4981-a650-651cc076af94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8ee09-a781-4c6b-8da1-d829345d2bb4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:45 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 Jul 10 08:07:45 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:45 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:45 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a Jul 10 08:07:45 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:46 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" returned: 0 in 0.749s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:46 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a Jul 10 08:07:46 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:47 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94.0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a" released by "_delete_snapshot" :: held 3.013s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" released by "delete_snapshot" :: held 3.034s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Created reservations ['d7b7ba96-1eb2-4283-b1a6-7a3527a8bfd0', '15bda621-2832-4882-973b-4eed39aac828', 'e85c3e81-d9b6-4420-983d-16493b7d8d91', '18ddf912-43a6-4deb-bec1-462cc00dc882'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:07:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-247d386a-9a11-423e-b09d-c3e180337b8a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-0d572d5d-bb38-4bb6-8a00-3f4918dcb06a-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-ca809ee1-d670-4981-a650-651cc076af94-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-ca809ee1-d670-4981-a650-651cc076af94-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963248b-cacd-459e-9c00-37b9bfe96769]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:48 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 Jul 10 08:07:48 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:49 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94" returned: 0 in 0.752s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:49 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94 Jul 10 08:07:49 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:49 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-ca809ee1-d670-4981-a650-651cc076af94" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-ca809ee1-d670-4981-a650-651cc076af94" released by "delete_volume" :: held 1.470s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Created reservations ['1f2ca034-73dc-4df1-bc52-01a1b9413374', '4353ca72-5014-4056-aa46-1b820877edd3', 'dd87f074-74a6-499f-a94d-beea46eccb7e', 'b23fac07-581a-4aae-b794-36542812f293'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:50 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:07:50 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:50 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:07:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:07:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21f39465-d196-4943-95ad-d61502983e00 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-ca809ee1-d670-4981-a650-651cc076af94-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (298eb859-7670-40ba-9379-5f20eb27c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f069307-f98f-40b2-a738-07344e3b464e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f069307-f98f-40b2-a738-07344e3b464e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533622064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c5bce-8832-48c5-8622-2e0cee01b8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:51Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54775cf0-3ed9-416f-9d67-0c3da2a01fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54775cf0-3ed9-416f-9d67-0c3da2a01fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4150129c-541f-41b2-af67-0158694ca8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4150129c-541f-41b2-af67-0158694ca8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662c5bce-8832-48c5-8622-2e0cee01b8ce', 'volume_name': 'volume-662c5bce-8832-48c5-8622-2e0cee01b8ce', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3892c20d-597f-4ed9-8912-7d1a5d5e34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3892c20d-597f-4ed9-8912-7d1a5d5e34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db2a98c-336c-453c-bdef-4f92bb0bf1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Volume 662c5bce-8832-48c5-8622-2e0cee01b8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662c5bce-8832-48c5-8622-2e0cee01b8ce', 'volume_size': 1} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533622064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c5bce-8832-48c5-8622-2e0cee01b8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:07:51Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Creating volume 662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:07:51 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:51 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce 1073741824 Jul 10 08:07:51 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:52 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce 1073741824" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:52 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce Jul 10 08:07:52 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:52 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db2a98c-336c-453c-bdef-4f92bb0bf1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662c5bce-8832-48c5-8622-2e0cee01b8ce', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b19dd6-d404-489f-b7a1-4e7585affd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:07:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Volume volume-662c5bce-8832-48c5-8622-2e0cee01b8ce (662c5bce-8832-48c5-8622-2e0cee01b8ce): created successfully Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b19dd6-d404-489f-b7a1-4e7585affd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:07:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (298eb859-7670-40ba-9379-5f20eb27c124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:07:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f0fa4b9b-b311-40d8-a8d5-f38f11410ae0 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:07:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot 7a21f049-2286-4433-8ebf-07dc091cd817 of volume 662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:07:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc7794-c0dc-414c-99b3-f573dcea781f]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:53 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce Jul 10 08:07:53 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:54 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:54 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 1G Jul 10 08:07:54 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:54 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 1G" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c5bce-8832-48c5-8622-2e0cee01b8ce -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:54 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c5bce-8832-48c5-8622-2e0cee01b8ce -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 Jul 10 08:07:54 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:55 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c5bce-8832-48c5-8622-2e0cee01b8ce -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:55 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 is being set with open permissions: ugo+rw Jul 10 08:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:55 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 Jul 10 08:07:55 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:56 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817" returned: 0 in 0.620s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:56 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info Jul 10 08:07:56 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:56 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:56 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info is being set with open permissions: ugo+rw Jul 10 08:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:56 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info Jul 10 08:07:56 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:57 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.info" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:07:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d768ea5b-2564-49e8-a23e-8c50642967a5 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-7a21f049-2286-4433-8ebf-07dc091cd817-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-7a21f049-2286-4433-8ebf-07dc091cd817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-7a21f049-2286-4433-8ebf-07dc091cd817" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-7a21f049-2286-4433-8ebf-07dc091cd817" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot 7a21f049-2286-4433-8ebf-07dc091cd817 of volume 662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf81cc-7a23-46bb-81ef-cabd3dcfd1d9]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:58 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 Jul 10 08:07:58 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:07:59 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 10 08:07:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817" returned: 0 in 0.737s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662c5bce-8832-48c5-8622-2e0cee01b8ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:07:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[34203d89-23c9-4f1f-a02d-6e820b9bf14e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:07:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:07:59 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce Jul 10 08:07:59 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:00 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:00 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 Jul 10 08:08:00 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:00 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:00 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817 Jul 10 08:08:00 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:01 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce.7a21f049-2286-4433-8ebf-07dc091cd817" returned: 0 in 0.625s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-7a21f049-2286-4433-8ebf-07dc091cd817" released by "_delete_snapshot" :: held 2.894s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" released by "delete_snapshot" :: held 2.914s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Created reservations ['b4d2f79c-a8c3-46c3-912d-12f23721c37b', 'ef022c8e-e8d3-4304-9e58-73fffac828c8', 'b73fbc99-b8ef-443e-8ab5-c39054b17e66', '65ee3af8-1a96-4102-85d0-f025271d1e91'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-80bfda25-8804-4028-aaf5-3b211a961697 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-7a21f049-2286-4433-8ebf-07dc091cd817-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-662c5bce-8832-48c5-8622-2e0cee01b8ce-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-662c5bce-8832-48c5-8622-2e0cee01b8ce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b50202-ad96-4cb0-b0ca-757f813dbf18]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:01 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce Jul 10 08:08:01 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:02 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce" returned: 0 in 0.750s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:02 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce Jul 10 08:08:02 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:03 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-662c5bce-8832-48c5-8622-2e0cee01b8ce" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-662c5bce-8832-48c5-8622-2e0cee01b8ce" released by "delete_volume" :: held 1.444s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Created reservations ['695cb7ac-8637-4ba1-972e-a42414960f55', '83f55c74-dc69-4669-ada8-3952937cf8b8', '67cfbe7b-62f9-4d23-a2b7-1f41d72f19d0', '9648ddb8-fc5b-4e95-ad0d-6f18aed2c5a2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:03 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:08:03 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:03 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:08:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0eb3c470-1731-4524-b839-a5529598969a tempest-ProjectMemberTests-2000425353 None] Lock "cinder-662c5bce-8832-48c5-8622-2e0cee01b8ce-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (a83a7101-c263-4c53-a5b8-279a0a156d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff8ba96-c76c-4eb9-afe9-afd59f1f40a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff8ba96-c76c-4eb9-afe9-afd59f1f40a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674451400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:08:04Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe1e130-657c-43fc-857b-d310124b0cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe1e130-657c-43fc-857b-d310124b0cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904b110a-0192-4081-a1d2-29381b3f9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904b110a-0192-4081-a1d2-29381b3f9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5', 'volume_name': 'volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec5b878-cf12-4185-8caa-dd69d2bb820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec5b878-cf12-4185-8caa-dd69d2bb820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257b5db-f56a-4dc3-9bc5-9c4b380ea9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Volume 45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5', 'volume_size': 1} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674451400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:08:04Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Creating volume 45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:08:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:04 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 1073741824 Jul 10 08:08:04 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:05 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 1073741824" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:05 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 Jul 10 08:08:05 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:05 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257b5db-f56a-4dc3-9bc5-9c4b380ea9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd53168-a9ec-4722-8b84-ff564de25877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Volume volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 (45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5): created successfully Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd53168-a9ec-4722-8b84-ff564de25877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (a83a7101-c263-4c53-a5b8-279a0a156d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:08:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cf9b0926-cb7a-49a8-be85-8d8848a0eddb tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:08:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot f3740ce7-c957-48bb-be1a-d588dccb3afe of volume 45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:08:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8b33c-52df-4a0a-8fdc-02398dbef848]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:06 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 Jul 10 08:08:06 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:07 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:07 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe 1G Jul 10 08:08:07 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:08 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe 1G" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:08 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe Jul 10 08:08:08 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:08 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe is being set with open permissions: ugo+rw Jul 10 08:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:08 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe Jul 10 08:08:08 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:09 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:09 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info Jul 10 08:08:09 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:10 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:10 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info is being set with open permissions: ugo+rw Jul 10 08:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:10 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info Jul 10 08:08:10 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:10 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.info" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1bf7b61a-6a70-4303-a2ec-7c31fde32916 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-f3740ce7-c957-48bb-be1a-d588dccb3afe-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-f3740ce7-c957-48bb-be1a-d588dccb3afe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-f3740ce7-c957-48bb-be1a-d588dccb3afe" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-f3740ce7-c957-48bb-be1a-d588dccb3afe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot f3740ce7-c957-48bb-be1a-d588dccb3afe of volume 45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7122925-59ce-4c75-be21-c3dd747ea2c2]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:11 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe Jul 10 08:08:11 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:12 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:08:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c0eb7-cd79-40d5-b922-8f992019d596]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:12 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 Jul 10 08:08:12 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:13 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:13 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe Jul 10 08:08:13 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:14 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:14 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe Jul 10 08:08:14 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:14 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5.f3740ce7-c957-48bb-be1a-d588dccb3afe" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-f3740ce7-c957-48bb-be1a-d588dccb3afe" released by "_delete_snapshot" :: held 2.990s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" released by "delete_snapshot" :: held 3.016s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Created reservations ['b68891e3-c1ee-46a0-9d4d-8bdcb78de233', 'e666322b-e1a6-4d7f-89d3-c4ebb8f644aa', '857b9dee-5dab-446c-b848-f48f6aeba35c', 'f5f51397-a286-4a8b-b019-81ae075214eb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e8ffa76e-d0e8-4246-86c0-3f7ad4dbb274 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-f3740ce7-c957-48bb-be1a-d588dccb3afe-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379f490-72a6-4a84-8186-27ec5027eb9e]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:16 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 Jul 10 08:08:16 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:16 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:16 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5 Jul 10 08:08:16 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:17 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5" released by "delete_volume" :: held 1.486s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Created reservations ['0b1aeb5e-f226-47c3-91e3-e76212640643', 'ed579f79-4c98-4c69-a2c5-af1a2e33e6e3', '653184ec-3934-4370-9a06-768ff8972a94', '23ce373e-7adb-40cd-9427-3197e6d56c1d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:17 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:08:17 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:18 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:08:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a2416c6a-979b-49ba-80a0-2c4e8a79c2b5 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-45dd0831-4a2d-4acc-a2ff-c3d5d1588cf5-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (9e83f834-a3f4-4ea3-8412-b84d9f993075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a43d4b2-9cd5-4aed-9da9-efc0ca117277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a43d4b2-9cd5-4aed-9da9-efc0ca117277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901820770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9db343e-dcbf-4c99-9767-9d5bf6780dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:08:19Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731fd4fd-5190-43a9-aa90-9b42949d7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731fd4fd-5190-43a9-aa90-9b42949d7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a60b73-8f54-43f5-bf98-6f293108e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a60b73-8f54-43f5-bf98-6f293108e370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9db343e-dcbf-4c99-9767-9d5bf6780dc6', 'volume_name': 'volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837a5b35-cc81-4567-acd3-39f81c58ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837a5b35-cc81-4567-acd3-39f81c58ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea4777b-c3d8-4d40-a8f7-3043a6c99f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Volume c9db343e-dcbf-4c99-9767-9d5bf6780dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6', 'volume_size': 1} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T06:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901820770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9db343e-dcbf-4c99-9767-9d5bf6780dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbe4a7541174a25a9e18b2961205a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T06:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T06:08:19Z,use_quota=True,user_id='ac25e4cdc8294ab1947ba14a993f152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5056d29d-6c59-48ee-a98e-9d34e91e8bd3),volume_type_id=5056d29d-6c59-48ee-a98e-9d34e91e8bd3)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Creating volume c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Selected osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 08:08:18 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] casted to osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895 Jul 10 08:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:18 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 1073741824 Jul 10 08:08:18 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:19 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 1073741824" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:19 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 Jul 10 08:08:19 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:20 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea4777b-c3d8-4d40-a8f7-3043a6c99f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c590bfa-f0d2-4867-ad4f-ec0efd8a8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 08:08:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Volume volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 (c9db343e-dcbf-4c99-9767-9d5bf6780dc6): created successfully Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c590bfa-f0d2-4867-ad4f-ec0efd8a8c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Flow 'volume_create_manager' (9e83f834-a3f4-4ea3-8412-b84d9f993075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:08:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4aa615e7-07bb-451e-9b7b-dfc7daea6a94 tempest-ProjectMemberTests-2000425353 None] Created volume successfully. Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Creating offline snapshot cebdac0a-9fa3-4607-892d-35397f776cd4 of volume c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7002ea1a-068d-4f03-a001-f92ca7d997e8]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:21 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 Jul 10 08:08:21 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:21 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:21 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 1G Jul 10 08:08:21 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:22 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 1G" returned: 0 in 0.773s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:22 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 Jul 10 08:08:22 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:23 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 -F qcow2 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:23 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 is being set with open permissions: ugo+rw Jul 10 08:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:23 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 Jul 10 08:08:23 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:23 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:23 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=116,cinder:SELECT=79,cinder:INSERT=30,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:23 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info Jul 10 08:08:23 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:24 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info" returned: 0 in 0.631s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:24 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info is being set with open permissions: ugo+rw Jul 10 08:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:24 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info Jul 10 08:08:24 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:25 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.info" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2dabdcb6-8032-40e8-88d7-0543b1959ff0 tempest-ProjectMemberTests-2000425353 None] Create snapshot completed successfully Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-cebdac0a-9fa3-4607-892d-35397f776cd4-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-cebdac0a-9fa3-4607-892d-35397f776cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-cebdac0a-9fa3-4607-892d-35397f776cd4" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-cebdac0a-9fa3-4607-892d-35397f776cd4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Deleting offline snapshot cebdac0a-9fa3-4607-892d-35397f776cd4 of volume c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] snapshot_file for this snap is: volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a131de-f585-4270-a4fd-befdb299e68a]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:26 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 Jul 10 08:08:26 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:27 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[de895039-7a2b-42a9-a770-708731a3eee4]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:27 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 Jul 10 08:08:27 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:27 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" returned: 0 in 0.762s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:27 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 Jul 10 08:08:27 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:28 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:28 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4 Jul 10 08:08:28 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:29 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6.cebdac0a-9fa3-4607-892d-35397f776cd4" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-cebdac0a-9fa3-4607-892d-35397f776cd4" released by "_delete_snapshot" :: held 3.001s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" released by "delete_snapshot" :: held 3.021s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Created reservations ['15a48631-7892-4f88-ad4c-c24c6bdeec7b', 'd1e20e67-e734-4a58-84e4-f2968553c568', '74556a62-32fc-41e5-b08c-1db578c00822', '466050e7-865a-42b0-87c1-38afa21479ad'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Delete snapshot completed successfully. Jul 10 08:08:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee98fa24-3681-4799-b235-56041aeb1701 tempest-ProjectMemberTests-2000425353 None] Lock "cinder-cebdac0a-9fa3-4607-892d-35397f776cd4-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-c9db343e-dcbf-4c99-9767-9d5bf6780dc6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-c9db343e-dcbf-4c99-9767-9d5bf6780dc6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77e365-9469-46b7-aed6-25ff50e9ed02]: (4, 'qcow2') {{(pid=88292) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 08:08:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:30 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 Jul 10 08:08:30 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:31 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:31 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6 Jul 10 08:08:31 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:31 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374/volume-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-quobyte-c9db343e-dcbf-4c99-9767-9d5bf6780dc6" released by "delete_volume" :: held 1.486s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:31 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Created reservations ['19c882c6-b823-46d0-a68f-2b9366ba05a8', '1db039b4-31d0-4804-8954-3285eed82bae', 'cb89d65f-b0ab-47c0-b149-de30464fbe23', 'e88f4eae-bc0b-4734-9b0a-fac30e96ef25'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:32 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:08:32 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:32 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:08:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Deleted volume successfully. Jul 10 08:08:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-749d3d00-6ed1-4684-80cf-f6f7e4ee727b tempest-ProjectMemberTests-2000425353 None] Lock "cinder-c9db343e-dcbf-4c99-9767-9d5bf6780dc6-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6430a336-5028-4c73-8347-6cbc0eabd895'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 08:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 08:08:36 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374 Jul 10 08:08:36 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 08:08:37 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 10 08:08:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/787e82fe3791c1e3d268bda1c213e374" returned: 0 in 0.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 08:08:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 08:08:37 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 08:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread count: 29 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 08:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8a45179-9bfb-4b43-8796-70e26f370409 None None] thread info: [<_MainThread(MainThread, started 125564644446336)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 08:08:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=17,cinder:SELECT=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 08:08:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}